On win98SE somewhere in here I think C:\WINDOWS\Application Data\Phoenix\Profiles
Atleast on the FAQ(http://texturizer.net/firefox/faq.html) it says:
"How do I uninstall Firefox?
If you installed Firefox using the installer for Windows, just uninstall it using the Add or Remove Programs applet in the Windows Control Panel.
If you installed Firefox using the compressed archives, just remove the folder you unzipped it to. Optionally, remove the profile folder, which contains all your bookmarks and settings."