One of the most interesting buildings in the historic district is the Louisville and Nashville Railroad Depot built in 1907.
Evergreen has a small but nice historic district with a few buildings of historic and/or architectural interest. They have a nice little park along the highway too.
Like the county courthouse, the city hall has burned down previously several times. The current city hall is better looking than the courthouse.