Doesn't sound like the ICV to me. It's probably working fine, but then getting dodgy instructions from the ECU. I would consider the TPS, or a messed up ECU. I assume you have no error codes at the moment?
I had the EXACT same issue as you, but it soon developed into an odd case of when the revs would take off by themselves. Nightmare in traffic, like you are giving it beans! Still never found out exactly what was wrong, but it seemed to sort itself out after I took off the TPS and gave it good clean. Previously to this, I'd changed the MAP sensor and ICV, both made no difference.
It could have just been the ECU throwing a wobble, but I'll never really know...