You can head to Necker anyway since the beaches are public! I have heard however you won't get a warm reception. The one sandbar near the lagoon might be a perfect launching spot!
G