Hello,
The second option would obviously be slightly faster as it's running 1 query instead of 2. However, I think you'd need to run the first option anyway so you can display page numbers/next/previous links otherwise there's no telling how much data to return.
Generally, I think with the speed of mysql, there'll be no noticable difference in the speed of your site if you run the first option.
Regards,
Adam.