"There are basically only two places I don’t swim off the boat. Anegada and Trellis bay."

I'm with you on both places. Lots of live-aboards in Trellis that have not moved in ages. The murkiness in the Anagada mooring field/anchorage puts me off, especially after I saw a photo of the 10' tiger shark that one of the Soares brothers caught several years ago just west of Neptune's Treasure. My ritual after the anchor or mooring ball is secured and the engines are off in every other spot is to jump overboard.