The supermarket across from the Capitainerie in Gustavia has good prices, and a wide selection of affordably priced wines; those are indeed almost the same prices as in St. Martin.

Le Select (Cheeseburger in Paradise) not only has affordable food and beer, but sits right in the middle of town at the main intersection, so you have a front-row seat for people-watching. There are only two other restaurants in Gustavia that serve food at prices mere mortals can afford, but the bakeries and cafes on the south side of Gustavia are good.