I agree with Mike's choices. I would add Anse d'Arlets and Ste. Anne on Martinique. I would also spend a week at Isles des Saintes! On the French islands, the food is great about anywhere.
I love St Lucia on land (especially the southern end by Soufriere) but it isn't particularly yacht friendly. The northern part has more fast food restaurants than the USVI.