Not on the Frenchside but close enough is https://www.oysterbaybeachresort.com/oyster-bays-new-veranda-market-bistro/

Veranda, OBBR and another place which I am not sure is still open was the place uphill from Captain Oliver’s which last I remember was Quai Ouest.