If no checked baggage I would say it’s doable. If you have global entry it’s a big help. There should however be a 11:30 ferry. What day are you traveling?