Hotel on the Cay is located on an island. It is accessible with a short ferry ride to the mainland. Have not stay there but have eaten their barbecue on Tuesday nights many times.
St. Croix is a great place to visit. Much more laid-back than St. Thomas and you drive on the left with little traffic.