At the moment I have a simple app which add a bunch of data from an external Api to MySQL with a select statement. I have the actual message text as the primary key, to prevent duplications of content since I want every entry as unique as possible.
Is it possible to somehow create a loop that can analyse a string of text/numbers, and then compare it to the database to see if anything is say an 80% match (any arbitrary figure will do.
E.g.
RT @envysportswear: Hello my name is John and I like to program. PHP is cool! - this is in my DB already
My app pulls in this message: RT @: Hello my name is John and I like to program. PHP is cool! - this is in my DB already - I want to exclude this since most of the message is the same.
Sorry if I didn't explain properly but hope you follow!
Thanks
