Engine Shimmey during maintenance throttle

This just started 2 weeks ago and has progressively gotten worse.
I can take off fine, but when i ease off the throttle to level out my speed (it can be at 30mpg or 70mph it doesn't matter) I get a shimmey in the engine. If i give it gas or let totally off the throttle it goes away.
I've even heard some clanking a few times. Almost feels like a car with a broke engine mount...other than the fact it only does it when leveling out.
I had a local shop just check the basics underneath, axles, mounts etc and they said it looked fine.
No engine light so I dont feel its a sensor. Kinda of makes me think the link between the electric motor and the gas motor is sending mixed signals. Anyone heard of this before?
Taking it to toyota this week I guess.