Hi Running Man
Apache 2 may have some stability and security issues (just like Apache 1 did in the beginning), and then again it may not. Until this has been firmly established, you shouldn't use Apache 2 to run your website live, although you can certainly use it to run your website if you don't have any security issues and are not expecting very heavy traffic. If you are using a hoster rather than hosting your website yourself, just like most people, then you won't have any choice about which Apache version your website runs on.
You can, however, use Apache 2 at home to test your website, indeed just for testing purposes at home you can use the newest, latest beta versions. I use Apache 2.0.42, PHP 4.3.4 and MySQL 4.0 on Win XP at home. My hoster uses Apache 1.3, as most still do, but has now switched to MySQL 4 instead of 3.23.
Best o luck
Norm