Enjoy the little lighthouse
This tiny little lighthouse is located right over near the harbor, just across from the Orient Hotel area. There is a sign out front indicating that this lighthouse contains the Victoria Seaport Museum.
Well, let's just say this.... museum is probably a bit too big of a word for the contents of this little lighthouse. It's more like a few "objects d'ocean" and so forth. There is a "Keepers of the Light" exhibit that traces the history of Victoria-by-the-Sea. There is no admission fee, although they do have a "donations" box. The whole thing is probably 30 square feet tops.
The little lighthouse is probably more a replica than having any functional use, although it's advertised as being genuine. Either way, it's a nice photo op, and climbing onto the top floor affords a nice look over the village AND will allow you to prove that you're "not that old". Yes, the ladder is pretty steep so watch your step. :)
If I lived in Victoria-by-the-Sea, I believe I'd take a walk completely around town every single good-weathered day. This charming little place is perfect for a slow afternoon stroll. You can vary each stroll with something different... maybe a trip over to Island Chocolates for some coffee and chocolate, maybe browse for books at the bookstore. Why not go over to the glass shop and see what the blowers have come up with recently? If she's open, you could get tea over at Mrs Proffitt's - at the Orient Hotel. You could even pet some of the local pets - who are well-known to about everyone and quite well-mannered.
If everyone lived in a town like Victoria-by-the-Sea and they took lots of afternoon walks, the folks who make blood pressure medication would go out of business.
For more commentary and photos regarding the "sport" of just walking around town, please check out my transportation tip on this Victoria-by-the-Sea page.
Linger at the tiny harbor
Victoria's "harbor" is more of a simple community dock. There are spaces for maybe three or four boats, and a few shops out on the deck. Walking out to the dock and spending a little time there is less "something to do" and more "a chance to do nothing but relax". We had glorious September weather, and the seabreeze was refreshing and invigorating.