I am putting on my safety nazi hat but make sure you have a plan for who will attend to the baby at all times if there is a emergency. Boats, even charter boats in the BVI have sunk in just minutes. A child was lost of Virgin Gorda a few years back. Have a plan for every situation and make sure the baby has some type of flotation while in the dinghy. Dinghy rides are probably the most dangerous part of sailing in the BVI.
G