Thanks! You know what, I just realised this morning that I must've been getting tenser and tenser which was why he was getting worse and worse (vicious cycle and all that). In fact, just before I started cantering out of the 20m circle to go down the long side of the school my exact thought was "I am going to DIE". I'm guessing he picked up on that, and I must have had a death grip with my legs without realising

.
Lesson learned!