A lot depends on what kind of food you want.

For extremely innovative French gourmet cuisine, l'Estaminet in Grand Case is perfect.

For excellent seafood with more traditional French preparation, l'Auberge Gourmande is a wonderful choice, but neither is on the water, if that's important to you.