Pac-SWI jack fail?

I have a kenwood head unit connected, (reverse harnessed to the stock stereo, stealth install) and got a PAC-SWI jack to maintain steering wheel controls, and lately the controll response has been really spotty.

Sometimes if I push really hard on the steering butting for volume up, I get it to work, and sometimes it doesn't work at all, and sometimes it works fine. Volume down, same problem, and input, things just seem to work sometimes, and sometimes they don't.

Any thoughts? is something just loose?