It's the same. Assume you have PHP3 installed in c:\php3 and PHP4 installed in c:\php, you can just add the following lines in your apache httpd.conf file:
ScriptAlias /php/ "c:/php/"
AddType application/x-httpd-php .php
Action application/x-httpd-php "/php/php.exe"
ScriptAlias /php3/ "c:/php3/"
AddType application/x-httpd-php3 .php3
Action application/x-httpd-php3 "/php3/php.exe"
Now you can have PHP3 and PHP4 at the same time. Just try it, good luck!