The fort area of Galle very historic and definitely worth a trip.
The whole area oozes charm, with lots of historic things to see and do.
There are plenty of beautiful shops, galleries and restaurants to help you wind your way through the small pretty streets.
It does however all seem to close quite early and most places close by about 9pm and lots of the restaurant are full by 7pm to factor that I when looking for something to eat. A lot of restaurant do not serve alcohol either, so be sure to check that out before you choose a table.