Really not much to do in town.
I do recommend you check out Dixies for their fried chicken (which is usually sold out by afternoon), Mimi's kitchen (the owner is so sweet!) for authentic island food, and Bath and Turtle actually has a coffee shop in the back making iced coffee drinks and baked goods until 2PM.
You've done the Baths but have you visited Spring Bay?