PHP Spider application

[sndyknght]

I am not sure if this is where I should stick this, but here goes anyway! We are looking at writing an application where a customer can look up prices of our products from a terminal. We want to be able to scroll competitors prices along the bottom of the screen. Grabbing the data real time would probably be too slow, so we would like to create some type of crawler that would scan sites for a similar item, save the data in our database, then pull it up when the customer performs a scan of the item they are price checking.

I can see how I can send a spider off into never never land looking for sites, but I do not see how I could get the price data from the sites. As I am typing this an idea is forming!

Anyway, if anyone knows of a script or some code that performs a function similar to this I would be most appreciative!

Oh and if this is in the wrong place, I apologize in advance!
Cheers,
Sandy

[bradgrafelman]

My idea would be to make sure you're only doing this on sites that have given you permission to submit automated requests, copy/store their data, and then later use their data for commercial purposes.

And if you're getting their permission, you might as well get access to an API that was designed for such a purpose rather than trying to screen-scrape HTML documents (which is, IMHO, just about the worst way you can go about trying to get information from 3rd party websites).

[sndyknght]

We wont be obtaining permission. I was thinking of simply gathering "public" knowledge, similar to what I would find if I did a Google search. I was thinking that a lot of these sites have a google feed and it would be quicker to grab the Google feed and parse it into a database.

Thanks for the input!
Sandy

[ewangeorge77]

You can try uninstalling then re-installing the game.If your game is not a original copy, it might be missing files.You can also try updating your graphic cards drivers and downloading the latest Direct X available.

Also make sure your PC specs. are enough to run the game.

[ewangeorge77]

You can try uninstalling then re-installing the game.If your game is not a original copy, it might be missing files.You can also try updating your graphic cards drivers and downloading the latest Direct X available.

Also make sure your PC specs. are enough to run the game.
_
24 hour payday loan | faxless payday loan | payday advance loans