A persistant connection is not done for every user, it's done only once for every child in the Apache pool; see www.php.net/manual/features.persistent-connections.php for all details. So it won't bring your server down (it's designed for this).
Note : persistant connections don't work in CGI mode. Do you use a module version with WIn2000/Apache ?