Resolving Full URL (?)

[dougal85]

Say you scrape a website and pick out all the links. You might end up something like this;

http://www.google.com/
/index.php
../img/test.jpg

and so on.

How would you go about checking and then working out the full urls?

I guess a simple check could look for http:// (or [url]https://)[/url] but what about when you have ../ ? or if a link links to something like irc (irc://)

Any thoughts?

[Kudose]

You could go about it how you normally would, except if the link starts with ../ or /, tack on the current URL you are scraping (replacing the .. of course).