Very nice views. If you are hiking down into the gorge, I would recommend proper shoes. It can be a bit muddy and slippery.
Lovely views from the many bridges (eg. David St, Mill St, etc) so you don't have to hike into the gorge if you don't want to.