Some adult age Dutch people will still frown at you when you ask the direction to go to Anna Paulowna but NS train ticket selling machine has the answer for you.
Trains in any direction around the country can reach Anna Paulowna in the north of the country (1.5 hour above Amsterdam)
Trains pass here every half an hour, and after that you can rent the bike. From the station there is a small road go to the church, on your left hand side there's a bike rental. What you need is just your passport number, no deposit but friendly service. The price ranges from 5.50 to 15 euro for a tandem. You can hire it for the whole day, be sure to ask when to bring it back. The route map is given for free together with the bike. There's free toilet to use inside the shop.
So far as I know, I don't see any other bike rental location as convenient as this one yet.
Other choice, there's also mini-train leaving from very near the train station. If you get out turn left and walk along the canal until you meet the main street, wait around the corner. Otherwise check on their website for booking info of www.jutterexpress.nl but with the train, there's specific route for it, so less flexible.