I need to take info from alltheweb.com. So I made a request through file() function for:
http://www.alltheweb.com:8080/search?q=+link.all:yahoo.com+-site:yahoo.com&c=web&cs=utf-8&l=any&no=off&co=1&o=0
It works fine. The parameter o=0 it means 10 results from 1 to 10. So if u put 10 it will show results 11 to 20.
BUT if I put o=1000 or something bigger than that the engines seems to block acces. Is there a work around that problem?