The Rainbow Bridge is totally worth visiting. The view on the river is magnificent.
There's a little park by the river with parking, a playground and little grills. There are shade trees and the town can be viewed from there as well. All you need to do is follow the road, it leads right into downtown, which is so quaint.