Although Tokelau itself is off the beaten path, you could REALLy get away from it all by visiting/staying on one of the many uninhabited islands.
The simplest way to do this is to arrange a trip to Sydney Island in Nukunonu, which is owned by the Luana Liki hotelier. Otherwise you might be lucky enough to befriend somebody else who owns an island and can arrange for you to go. Otherwise, you are not allowed to set foot on any of these islands without prior permission.
See my earlier chapters on Sydney and Tokelau islands.