In addition, if there should never be duplicate data, why haven't you added a UNIQUE key?
EDIT: Also, to add to the above; if you use sessions to track whether a form has already been submitted (search the board or Google - this is another somewhat common topic), then there's no need to do a 'delete' check or anything... just stop the INSERT from ever happening.
As I mentioned above though, if you have a situation where you never want duplicate data, adding a UNIQUE key to your database would be a simple way to solve this. That way, when you perform the INSERT query, you can check if MySQL returns an error code stating that a duplicate has occurred and you can then display an appropriate error message.
EDIT2: Guess I should replace 'MySQL' with 'DBMS' since you didn't explicitly state you were using any specific one. :o