For a nice view of Confederation Bridge on the Prince Edward Island end, drive towards the bridge and make a left turn at the last traffic light before the toll plaza. Continue down this street (Borden Avenue) until you reach the lighthouse.
For any lobster lovers, there is a small store on the south side of the Trans-Canada Hwy that sells frozen & canned lobsters along with maritime related souvenirs.
I didn't get a chance to see it on this trip, but there is a piece of the bridge girder on display somewhere in this town.
The Confederation Bridge is the longest bridge over ice-covered waters in the world, and goes from Borden to New Brunswick. It takes about 15 minutes or so to drive from one end to the other. It took many years to build and opened in 1997. It's the preferred choice for getting on and off the Island (the only other option is by plane, or by ferry from Wood Islands to Nova Scotia), and if you don't have a vehicle or are not taking the bus, you can take the shuttle to get to the other side.
Driving is the easiest way to get to and around Borden-Carleton. It's also the best way to cross the Confederation Bridge. There is also a shuttle going across the bridge for those who have no other way to go (bikes and pedestrians are not allowed on the bridge) and I think it runs every 15 minutes or so.