I'm not sure about your mower, but I have seen some that have a small spring under the key and make the gear act like a ratchet when pulled backwards. Are you sure you have the correct key? What model number Toro do you have?
My model number is 20043. There isn't a spring and these are the original keys to it.