As dagon points out, the SANITIZE_EMAIL filter is, IMHO, useless and should never be used.
Otherwise, yes, all of those characters you mentioned could still pass validation. After all, those are valid characters to use in an e-mail address. For example, this e-mail address:
"Test<'>Me"@mydomain.com
is perfectly valid.
EDIT: Also note that "stripping out" characters doesn't make sense either.
If I told you my phone number was 123-4567, and you decided that you didn't like the numbers 3 or 7 and stripped them out, do you think the phone number "124-56" would still reach me? Same applies for e-mail addresses.