We're at Diamond Cay now which is pretty choppy. I should have seen that coming with the ESE wind we still have today.

PredictWind is showing the wind waves, which are not the swell that Z is referring to. Those will be from the north and are the long rollers you see out in open water from distant weather.

The longer the period, the more energy these swells carry and expend when they reach the shore.

EDIT: and, yes, White Bay probably inadvisable in the coming days as well. Great Harbor is a good alternative and a short cab ride (or dinghy if conditions allow).