[RESOLVED] Help scraping some data

[scrupul0us]

Normally i can handle scraping data no problem but I'm running into a road block here that I cant think of a elegant solution for....

I've just finished ripping all 9 seasons of Seinfeld to my NAS and the only thing I have to identify them is 4 digits, 2 digits for the season and 2 for the episode

so I pulled up epguides.com thinking I could scrap the data and rename them all with PHP...

well if you examine the page:

http://epguides.com/Seinfeld/

everything is bundled into one giant PRE block

given:
2. 1- 2 103 31 May 90 The Stakeout

I need the episode number:1- 2
I need the title: The Stakeout

source: 0102.avi
resultant: 0102 - The Stakeout.avi

i can do some manipulation on the episode number so that it will match what I have: 0102 but at the very least I need a way to get it

it seems to me a dirty regex is going to be needed unless there is another site/service out there that might provide the data in a more usable fashion

any takers / ideas?😃

thanks

[scrupul0us]

Just an update... I did some more looking and TV.com had something more workable:

<?php
$file = 'episode.htm';
$doc = new DOMDocument;
@$doc->loadHTMLFile($file);
$xpath = new DOMXpath($doc);

$find = array("\n", "\r", "\t", "  ", "\o", "\xOB");
$epSea = '';
$epNum = '';
$epNam = '';

$elements = $xpath->query("//div[@class='info']");
$length = $elements->length;

function checkLength($str)
{
	/*
	a string is an array of characters
	by checking for position 1 I know if theres 2 chars
	*/
	if(isset($str[1]))
	{
		return $str;
	}
	else
	{
		return '0'.$str;
	}
}


for($i=0;$i<$length;$i++)
{
	$elements = $xpath->query("//div[@class='info']/div[@class='meta']");
	$epData = str_replace($find,'',$elements->item($i)->nodeValue);	

$epSea = checkLength(preg_replace('/(.*)(Season )(\d{1})(.*)/', '\3',$epData));
$epNum = checkLength(preg_replace('/(.*)(Episode )(\d{1,2})(.*)/', '\3',$epData));

$elements = $xpath->query("//div[@class='info']/h3/a");
$epNam = $elements->item($i)->nodeValue;

$episodes[] = $epSea.$epNum.' - '.$epNam;
}

echo '<pre>';
print_r($episodes);
echo '</pre>';
?>

it's not done in terms of the rename but this will work great for fetching the data and is reusable for other stuff as I rip my collection 🙂

[scrupul0us]

Here is the finished script... believe it or not I spent more time figuring out why I couldnt access my nas mapped drives vs coding

<?php
$file = 'episode.htm';
$doc = new DOMDocument;
@$doc->loadHTMLFile($file);
$xpath = new DOMXpath($doc);

$find = array("\n", "\r", "\t", "  ", "\o", "\xOB");
$epSea = '';
$epNum = '';
$epNam = '';

$elements = $xpath->query("//div[@class='info']");
$length = $elements->length;

function checkLength($str)
{
	/*
	A STRING IS AN ARRAY OF CHARACTERS
	IF POSITION 1 IS VALID THEN THE STR HAS AT LEAST 2 CHARS
	THIS 'COSTS' LESS THAN USING STRLEN
	*/
	if(isset($str[1]))
	{
		return $str;
	}
	else
	{
		return '0'.$str;
	}
}

for($i=0;$i<$length;$i++)
{
	//EP SEASON AND NUMBER
	$elements = $xpath->query("//div[@class='info']/div[@class='meta']");
	$epData = str_replace($find,'',$elements->item($i)->nodeValue);	

$epSea = checkLength(preg_replace('/(.*)(Season )(\d{1})(.*)/', '\3',$epData));
$epNum = checkLength(preg_replace('/(.*)(Episode )(\d{1,2})(.*)/', '\3',$epData));

//EP NAME
$elements = $xpath->query("//div[@class='info']/h3/a");
$epNam = $elements->item($i)->nodeValue;

//KEY THE ARRAY WITH THE 4 DIGIT EP NUMBER FOR EASY LOOKUP LATER ON
$episodes[$epSea.$epNum] = $epNam;
}

/*
THE FOLLOWING FUNCTION IS A MODIFIED VERSION OF:
http://www.codingforums.com/showthread.php?t=71882
*/
function renameAllEpisodes($path,$level = 0)
{
    $ignore = array('.', '..','folder.jpg');
    $dh = @opendir($path);
	$renamed = '';
	global $episodes;

while(FALSE !== ($file = readdir($dh)))
{
	if(!in_array($file,$ignore))
	{
        if(is_dir("$path\\$file"))
		{           
            renameAllEpisodes("$path\\$file",($level+1));            
        }
		else 
		{            
            $tmpName = substr($file,0,4);				
			if(array_key_exists($tmpName,$episodes))
			{
				$renamed = $path.'\\'.$tmpName.' - '.$episodes[$tmpName].'.avi';					
				rename($path.'\\'.$file,$renamed) or die("could not rename $file to $renamed");
			}
		}        
    }    
}    
closedir( $dh );
}
//renameAllEpisodes('\\\\10.1.1.15\\Disk-1\\TV\\Seinfeld\\');
?>

and albeit I spent more time doing this than hand editing the titles but I can re-use this over and over 🙂

[scrupul0us]

I made one additional change that will benefit Windows users... I added a check function for the episode title to remove any characters that are invalid for use in filenames

<?php
$file = 'episode.htm';
$doc = new DOMDocument;
@$doc->loadHTMLFile($file);
$xpath = new DOMXpath($doc);

$find = array("\n", "\r", "\t", "  ", "\o", "\xOB");
$epSea = '';
$epNum = '';
$epNam = '';

$elements = $xpath->query("//div[@class='info']");
$length = $elements->length;

function checkLength($str)
{
	/*
	A STRING IS AN ARRAY OF CHARACTERS
	IF POSITION 1 IS VALID THEN THE STR HAS AT LEAST 2 CHARS
	THIS 'COSTS' LESS THAN USING STRLEN
	*/
	if(isset($str[1]))
	{
		return $str;
	}
	else
	{
		return '0'.$str;
	}
}
function cleanName($str)
{
	$invalidChars = array('*','|','\\','/',':','\"','<','>','?','.');

return str_replace($invalidChars,'',$str);
}
for($i=0;$i<$length;$i++)
{
	//EP SEASON AND NUMBER
	$elements = $xpath->query("//div[@class='info']/div[@class='meta']");
	$epData = str_replace($find,'',$elements->item($i)->nodeValue);	

$epSea = checkLength(preg_replace('/(.*)(Season )(\d{1})(.*)/', '\3',$epData));
$epNum = checkLength(preg_replace('/(.*)(Episode )(\d{1,2})(.*)/', '\3',$epData));

//EP NAME
$elements = $xpath->query("//div[@class='info']/h3/a");
$epNam = cleanName($elements->item($i)->nodeValue);

//KEY THE ARRAY WITH THE 4 DIGIT EP NUMBER FOR EASY LOOKUP LATER ON
$episodes[$epSea.$epNum] = $epNam;
}

/*
THE FOLLOWING FUNCTION IS A MODIFIED VERSION OF:
http://www.codingforums.com/showthread.php?t=71882
*/
function renameAllEpisodes($path,$level = 0)
{
    $ignore = array('.', '..','folder.jpg','thumbs.db');
    $dh = @opendir($path);
	$renamed = '';
	global $episodes;

while(FALSE !== ($file = readdir($dh)))
{
	if(!in_array($file,$ignore))
	{
        if(is_dir("$path\\$file"))
		{           
            renameAllEpisodes("$path\\$file",($level+1));            
        }
		else 
		{            
            $tmpName = substr($file,0,4);				
			if(array_key_exists($tmpName,$episodes))
			{
				$renamed = $path.'\\'.$tmpName.' - '.$episodes[$tmpName].'.avi';					
				rename($path.'\\'.$file,$renamed) or die("could not rename $file to $renamed");
			}
		}        
    }    
}    
closedir( $dh );
}
//renameAllEpisodes('\\\\10.1.1.15\\Disk-1\\TV\\Seinfeld\\');
?>

[scrupul0us]

Edit: You'll have to make the following change to allow for shows with more than 9 seasons

Change:

$epSea = checkLength(preg_replace('/(.*)(Season )(\d{1})(.*)/', '\3',$epData)); 

To:

$epSea = checkLength(preg_replace('/(.*)(Season )(\d{1,2})(.*)/', '\3',$epData));