Ahh.. BETWEEN! I didn't think of that.
Thanks...
For those who've read this far here is what finally worked
1st I selected all referees who were assigned a game during the Time span and Date I was searching for.
"SELECT referee1,referee2,referee3 FROM referees WHERE game_date=$gdate AND ((game_start_time BETWEEN $gtime1 AND $gtime2) AND (game_end_time BETWEEN $gtime1 AND $gtime2))"
I dumped the result into a temporary table (templist)
Then to find all referees who haven't been assigned I used the following search
"SELECT R.* FROM referees AS R LEFT JOIN templist AS T ON R.id_ref=T.id_ref WHERE T.id_ref is NULL"
Thanks for all the input.
Paul