If you are going to use mysql/php on windows then yes, there are plenty of php printer functions to use.
However, there is not graphical report builder in php such as you get with access. If you already have the print jobs set up in access then it would probably be easier to carry on using them. You can connect to mysql from access using odbc so the access report could get it's data that way.
Alternatively, you can just generate html output with php, view it in your browser, and print from there. I use different css style sheets for 'printer-friendly' pages when I want users to be able to print them out nicely: monochrome fonts and grey-scale graphics and such-like.