My group is likely going to Guadeloupe for the next trip. It may fit what you've described. I'm not sure how quiet the anchorages will be, but there is definitely hiking in the mountains to huge waterfalls. There is French food too.