your problem is that you used double-quote in wrong place.
just change the variable like this:
$site="<a href='http://www.mydomain.com/newsletter.php'>link</a>";
or:
$site="<a href=\"http://www.mydomain.com/newsletter.php\">link</a>";
you should take a look at the "Strings" in php.