duplicate with 2 arrays

[jamma-pcb]

Hi all

I have an array populated with full urls. Thing is I wish to reduce the urls down to the root domain with no www to make sure there are no duplicates. But I want to output the full urls instead. Kind of using the root to output the full urls. It should gaurantee unique full urls and only 1 page from each domain.

any help would be appreciated.

pcb

[laserlight]

You can iterate over the array with [man]parse_url/man to get the host name, and then strip out "www." from the front of the host name.

You have to watch out for "www.com" and similiar cute domain names though.

[jamma-pcb]

Hi Ive used regex for root domains. @ is I'm trying to use that a unique reference then output its full url..

Any ideas on that one

[laserlight]

Keep it as a 2D array, e.g. by using the domain name as the key of an array of "full" URLs.