Most charter boats don't have enough rode to anchor properly outside the mooring field, the water drops of quickly.
If you do have to anchor use two anchors spread out like a Bahamian mooring so you're more or less in the center and you won't swing.