Make sure to go up to Harper House and beyound. There is a neat cemetary along the way to Jeffersons Rock. This is a rock formation that hovers out over the town below. If you are a photography buff this view is spectacular. Also make sure you walk across the bridge that spans the Potomac River. You also get a great view of where three states meet.
The town is filled with history and fun. If you are not a Civil War buff this is still a interesting town. Of couse the history starting with John Brown and talking of the various floods is most enlightening.