create each letter as a link to the search page using something like
<a href=search.php?id='A'>A</a>
then in the search page the sql looks like
$name=$_GET['id']; //pull the letter from the link
$sql="select * from mytable where artist_name like '$name%'";
$result=mysql_query($sql);
//blah blah blah
hth