The shared memory isn't going up? If the shared memory isn't going up I would not suspect the cache to be the problem with memory use increase. Caches are almost universally shared memory in databases, and I'm sure MySQL does the same.
Without running MySQL under a debugger that can check it for leaks, I can't really comment on whether it's a real memory leak or maybe a local cache / global cache architechture I'm not familiar with.
But generally a crowing cache shows directly in an increased shared memory usage.