Keep in mind that most of the shops in St Barth your wife and daughter might be interested to shop in close for about 3 hours for their long lunch. Between the time the ferry docks and goes through customs/immigration and the time it departs back to SXM doesn't really allow a lot of time to shop, have lunch and tour the island.