This house was built in the early 1800s most likely by Mosher Hoag.  His daughter, Hannah, married William Seward Vantine and the house later became Vantine's  Inn and was a popular summer tourist place.  Legend is that when the second story was being added, cannonballs were found that had been fired during the war or 1812. The house was later owned by Richardson.