I did some more investigation and now it appears that it works for anyone, but only after visiting another page on the site, which means I think it fails a REFERER check ... weird.
I wanted to put a link to my profile here on another site ... it doesn't work.