duplicate

[wsh]

How do I wipe out all dublicate entries from a table with no id column? Lets say I have 300,000 entries and god knows how many are duplicated of others (spam) ... how do I get it to go through and take out all the copies of entries. So there is only one of everything. This can be done as maintenance, does REPLACE INTO work to serve my purpose incase someone submits something the same again? Or would that be too slow on such a large db?

Thanks!

[Kristopher]

This method will probably take awhile if you have that many records, but:

$results = mysql_query("SELECT UNIQUTE FROM table");

if ($result = mysql_fetch_array($result)) {
  mysql_query("DELETE FROM table");
  do {
      //re-insert all information here
  } ($result = mysql_fetch_array($result));
}

[wsh]

Thanks... doesnt work thought. I cant put the whole dump into the file (the file would be over 50MB!)