i used webmin for awhile, but didn't care much for it
do you have physical access to the server, monitor, keyboard, mouse, etc...
cuz if you do, i would use kde or gnome instead of webmin
and you don't have to have the gui run by default, you can just run a command to start it when you want