Right off of my head, it sounds you'll have to code the logic to handle which records to show ...
If OFFSET is the number in where to start and RECORDS is the number of records you want to display, have a look at this :
Idea 1 : Read your records OFFSET times. From there continue to read your records RECORDS time and print each row.
Idea 2 : Select records from your DB where the key is between OFFSET and OFFSET+RECORDS. This would be quite silly if you have gaps in your keys (eg. 1 2 3 5 7 8 9 and so on)
Idea 3 : Use a DB that does indeed support limited selection. Mysql?