You are considered in that case as a international traveler arriving in the US by air. Had you ferried to the USVI by boat and then flown out the test is not required. As others mentioned however the USVI requires a test 5 days prior.