I used myODBC (available from mysql.com) to accomplish this.
Just download and install myODBC on your Windows computer. Then you configure myODBC to connect to the mysql database on your linux machine. After that configuration is successful, you can link the tables in the mysql database to your Access database by attaching the tables through ODBC.