Nice and quiet village in Vardo. There is a old fortress in Vardo and you can go visit it.It is nice to walking through and stand on the wall of the fortress, they also have some canons and small museum. I only had 1 hour there, before ship of Hurtigruten was going on, but it was very nice there.
Vardoe Museum is by the locals named "The Louse Hill" because the building now housing the museum used to be a hospital.
Inside you will find several exhibitions where the focus is on the rich history of this small township, including the time around the Witch Executions, the Russian October Revolution of 1917 and the WW II.
The island of Hornøy is actually the main attraction here, so I believe. It is mainly for the bird watchers and on the right season it can be rather crowded island.
Vardø is an island, of course the best thing here is the sea and the best you can do is to take a small boat and sail to the other islands around.