you can use LIMIT in your queries to limit the number of results.
SELECT stuff FROM table WHERE something LIMIT 0, 25
the first part, 0, specifies what record to start at (record counts begin at 0, not 1), and the 25, tells how many records to return.
So LIMIT 100, 25 would show 25 records starting from number 101.
you can use the query string to pass along the starting record, and leave the 25 part static or retrieve it from user preferences. you may need to error check the start portion if it is in the query string in case the user puts negative numbers or words, it could mess up your query and case some mysql errors in your script.