Sunny Point was vacant during the Civil War. It is believed that, early in the war, Confederate soldiers used the attic of the house as a lookout when Union forces were approaching down the St. John's River. In 1864, Union troops occupied the city of Palatka and utilized Sunny Point as an encampment. The house was also utilized by Union troops as a lookout for Confederate blockade runners.