Dive bar...Green Parrot, live music one block from mile zero marker at courthouse.
Look for “Champagne Carl” at the Green Parrot or other local venues.
Great local Cuban food, though not elegant. El Siboney
Duval St joints are mostly tourist traps. Waterfront area including the Raw Bar are good options. Lots of reviews on line.