I would suggest using a longer bolt in place of the hold down in the end of the torque shaft and using a puller against that. A longer bolt threaded in place will allow the lever to be pulled over the shank of the bolt while the puller is pressing on the head of the bolt. Does that make any sense?
I bet it will slip off without much fuss.
I bet it will slip off without much fuss.