For extremely innovative French gourmet cuisine, l'Estaminet in Grand Case is perfect.
For excellent seafood with more traditional French preparation, l'Auberge Gourmande is a wonderful choice, but neither is on the water, if that's important to you.