I recommend the A&E Lobster House for a nice formal dinner. I had a surf and turf there that was excellent and my wife had a great seafood au gratin. It overlooks the harbor and you can sit outside facing the water if you like.