Another option depending on how long your trip is - you could head to St. John. Check in that morning in Cruz bay and have them take a ferry from there, then spend a couple days in St. John.

We actually did this our last trip, although we picked up friends there rather than drop them off. Worked out great and we had a couple great days in St. John.