In order to clear into the USVI you normally have to have paperwork showing you cleared out from somewhere. In practice I don't think the customs guys in Cruz even ask but that is the procedure. I know several people who do exactly what you mention and have not had issues. With my travel requirements I don't want to get on a immigration bad list so I follow the rules.
G