You can provision from Riteway and ask a taxi to pick them up and meet you at EIS or the Scrub Ferry.

We have a house on Jost, so we provision and have Iris Penn pick up our provisioned groceries. She meets us at the ferry dock on Tortola and off we go via water taxi. Fee involved for transport, but she is so dependable!