It really depends on the Swell size and actual direction. Cooper can as a example be fine if the swell is moderate and from the N to NNW. It's worse if it's NNE. CGB can still be used if the swell is moderate and from NNE and you tuck into the eastern end.
Usually no issue are Trellis, Marina Key, Peter-Great Harbor,little Harbor and back island anchorages, JVD-Great harbor, little harbor and diamond key. The Bight and North Sound anywhere. Sopers is usually fine unless it's really a large swell.
Moderate or less swell and somewhat directional dependent would be CGB, Anegada, Cooper, Deadmans Bay.
I would consider moderate to be 4 feet or less. It also depends on if you are on a monohull or cat. Keep in mind that the North Swell is 95% a winter issue.
G