alot of jpegs.

[patael]

hi
well, this is my problem, i need to get 150,000 jpegs I dont care of there quality or whats including them (dont ask why, this is long story).
i built a code that scans a directory and its sub directories for any Jpegs(by using the readdir function) and stores them at my local computer, it works fine as long as i scan my computer.
If i try to scan a directory such as http://www.somesite.com/images the debbuger was going wild.
some errors like the directory wasnt found and so and so...
so what is the way to scan a web directory, find some jpegs and about storing them at my local dont have a problem.
lets say some thing like google but of course less sophisticate.
thank u alot

[juschillinnow]

it's porn ! 😃

oooh. 150,000 jpegs. Not sure if php is the right solution to handle gathering that info. It would probably require you to keep track of where you left off, kill the script every so often and restart where you left off.

[leatherback]

Hm..

Ever heard of COPYRIGHT !?

J.

[Mordecai]

You can't include someone else's directory. Read_dir() is only for use on the local system.

You'd have to get a list of all the files and weed out what's JPEG and what's not. Also, as someone said earlier, you'd probably have to kill the script several times. PHP, as a default, can only use 8MB of memory per script, and 150,000 JPEGs might take all of that up. Also, it will time out at the default of 30 seconds, which will probably come before 8MB of RAM.

[patael]

for that.