Definitely take the earlier ferry, and if all goes well store your luggage at their counter and enjoy Charlotte Amalie for the morning.