set a permanent cookie, check to see if this cookie is present, if so then don't let them vote. I wouldn't depend on the IP address as these can be dynamically assigned, firewall, etc. If you are taking votes from people you know (ie members) then just track what polls a member has taken and don't show the ones that fit this.
amc