As StormJib said - there are plenty of incidents that can happen on a plane where you will survive and would survive with fewer injuries if your wearing a seat belt.

I think the only reason they allow kids under 2 to fly without a seat belt is simply because there hasn't been an incident with a child being killed. The day that happens, I'd imagine the rule will change.