We did an overnight trip, stayed at Serenity Garden, which was beautiful. We took the ferry from Marigot, and rented a car at the ferry dock. As a British island, driving is on the left-hand side of the road, so that took a bit getting used to, but there's very little traffic on the island. I'm not sure I'd do it again, but agree that you should do it at least once.