The weight of the bicycles also extends upwards from the receiver, and if you are launching, that's a 1g load at several feet from the mounting point. And for most bike racks, all of the mass of the carried items is attached at the upper end of that moment arm.
Whereas when towing, the hitch...