parallel execution

[imranlink]

Hi,

I want to collect data from more than 10 sites by using CURL

$URL1 = "https://www.site1.com/page1.asp;
$URL2 = "https://www.site2.com/page2.asp;
$URL3 = "https://www.site3.com/page3.asp;
$URL4 = "https://www.site4.com/page4.asp;
$URL5 = "https://www.site5.com/page5.asp;
$URL6 = "https://www.site6.com/page6.asp;
$URL7 = "https://www.site7.com/page7.asp;
$URL8 = "https://www.site8.com/page8.asp;
$URL9 = "https://www.site9.com/page9.asp;
$URL10 = "https://www.site10.com/page10.asp;

This take long time becuse my PHP script execute line by line for fecthing the data by $result = curl_exec ($ch);

Suppose $URL1 take 15 seconds to fecth data so whole script will take 10 x 15 = 150 seconds. is there a way that all 10 URLs run in paralle and all takes only 15 seconds?

Is there any why that i send query to all these 10 sites in parallel[samultaniously] and all 10 results execute as parallel execution to save the time?

How can i minimize the execution of getting data from more than 10 sites? Any idea of parallel processing ?

How will then i shall sum the 10 parallel results in one page?

Regards,
Imran Khalid
[e-mail]

[maniac1aw]

I don't know how to parellel process but here is an idea.

Create a php to CURL the ten pages at an interval you specify. Then store the results into files or a database. Then your program can read or query those. They won't be "realtime" but you could could schedule the job to run as often as you like to keep your stuff up to date.

just an idea