No need to clear out of USVI. You must pay an environmental fee entering BVI, $20 I believe.
Coming back, you will have to clear back through customs at ferry dock and at the airport.