Yes, do try out apache for windows. it works almost as fast as it does on unix and you can use the PHP installer to auto-install PHP with it (although my preference is to get the full PHP distrib -- because of the extensions -- and install it manually).
One bug that I've found which doesn't affect all users is that on system shutdown, sometimes apache will produce an application error saying a memory segment could not be read.
I found that this happens if I restart apache after system boot with the zlib or bz2 extensions on.
Nevertheless, this error has caused no harm so far and it doesn't really affect you unless you really mind clicking the OK button in the application error.
I've also used 2.x versions on windows and it works just fine. But go with 1.3.26 (or later) and you'll have no problems.
-sridhar