If it were me and I felt that the chairs were too close, I'd ask him to move them a little or just go somewhere else.