Did you install the exact apps on the 64 bit system as you did on your 32 bit machine?
It is not clear what you mean by memory usage. Memory used by linux, or php scripts?
BTW, no matter how much memory you have on a linux box, eventually linux will gobble it all up, due to caching for faster access. What you probably should worry about is if your machine is using swap memory. Run top.
I think this is a question for a linux forum though.