Well, you have quite a few options. You can use Uniform Server (google it) which is Apache, PHP, mySQL, phpMyAdmin, PERL all in one. Or you can use XAMPP Lite which has the same features.
PortableWebAp is another good solution, although you have to pay for it.
So there are three solutions that do exactly what you want. Choose one and roll with it 😉