We typically visit in April or November. I think both of these times would fit with what you are looking for. We like November because the hurricane season is pretty much over. Also,all of the restaurants/beach bars are open. Like you,we like to have people on the beach and bars to socialize with and find the crowd size just right in November. Enjoy your trip!