Congratulations you picked two rolly anchorages.
Lindbergh is rolly when the winds are a bit south and Red Hook is slammed by the wakes of the ferries.
I would anchor in CA the first night where there's plenty of bars and restaurants in dinghy range or grab a mooring ball at the anchorage near Caneel Bay on St John and meet your friends at one of the bars or restaurants in Cruz bay next to the ferry dock