get_meta_tags question

[hancocj]

I am writing a script that acts like a spider crawling remote web pages for text and meta tag information. Initial test worked great when defigning the url to spider like this:

$url = "http://www.somesite.com";

Using the functions get_meta_tags and strip_tags I was able to parse out the desired info needed to add to the database. However when I started reading a file of submitted urls the get_meta_tags function only worked on the very last url in the file?

Any Ideas?

[Weedpacket]

What it sounds like is that it's going through the entire list of URLs, and running get_meta_tags on each, but you're not saving the results; the results from each URL are being overwritten by the results from the next so that only the last survives.

[hancocj]

Thanks for you reply weebpacket. What was happening is there was a \n at the end of the url in the file so it would only work on the very last url because there was no \n.