With houses dating back to the late 1600's, Huguenot Street is the oldest residential street in America. The Huguenots had fled discrimination and religious persecution in France and Belgium and arrived on the banks of the Wallkill river. Seven stone houses remain today, with additional structures from the same time period as well.

The DuBois Fort was built primarily as a home for the DuBois family but also had a second purpose as a "fortress" should the community need protection. Thankfully, that was never necessary.