Check out the turtles nest inn. It's a bit from Rum Point but they have a great beach, nice kitchenettes and a pool. Very reasonable!

"We lost our corkscrew and were compelled to live on food and water for several days.
~W.C. Fields"