if you are running on a unix server you can make a system call to either chmod or chatter (via system() or similar) and turn off readability. it will mean that the "off" scripts will 404 when sought (or maybe return an uglier error... i haven't tried). You may run into permissions errors when calling chmod or chatter (ie, if your server runs under a different account than the one your scripts are chowned to).
Alternatley, you can write a script that fopens up the script you want to turn "off", reads it into a var, put "die;" or "header("Location: ")" at the top and then re-writes it to disk. Not a very pretty solution though.