Villa Olga (340-715-0900, http://www.villa-olga-inn.com/) in Frenchtown is inexpensive and on the waterfront. It's close to CYOA Yacht Charters, Oceana (4*) Hook Line & Sinker (3*) and many other good Frenchtown restaurants.

Be prepared to walk some steep stairs if you stay there.