If all you are doing is unhooking the speedo cable you are doing it the hard way.
Put the small bolt back in, what you are doing is working on removing the speedo driven gear housing.
Now the cable is threaded onto the housing, so look at the ribbed portion and unscrew it...Channel locks may be required, but hopefully not.