The original thinking must have been that the upper part of the seat needed a secure attachment to the frame through the headrest structure. When climbing hard, the counterforce of the pedal stroke is transmitted through the upper seat ultimately to the frame. The way the system is designed, the force is in direct compression from the rider's upper back to frame so no mechanical connection is necessary. And yes, in tension (like picking up the bike using the seat) the Velcro ought to work as long as its glue doesn't fail. However, it is not a perfect world - glue fails and forces from the pedal stroke can be… ummm undisciplined, thus the clamps.
But your real-world experiences show no clamps are necessary, yes?