Depending on your flight time consider staying on STJ instead. More of an "island" vibe and great restaurants in Cruz Bay within walking distance of the ferry. The ferry to Red Hook runs on the hour.