I would be inclined to wait until after your arrival on the island. Since you are staying close to the ferry departure, it will be easy to make your arrangements taking the weather into consideration. It is definitely no fun to go on a day with rough seas and sunshine makes for a nicer day too.