One place more that I didn't think of that meets your criteria OP is the Nettle Bay Beach Club which on the French side. It is right on the water and close to dining and drinking establishments. Check out the trip reports by BEERMAN. Carol can tell you how to access them. I am completely inept at doing stuff like that.