While the boater may be responsible, this seems to a be a rule of tonnage thing too. I would sure be on the lookout for boats. Also, considering how loud motors are underwater, it's surprising that the swimmer didn't hear you first.