Been there several times by boat and therefore stayed at Port Elizabeth. There are several restaurants, markets and other local shops in this area. As far as which side is better, that depends on individual tastes and I'm not familiar with Atlantic side.