Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

Eliminating duplicate records

Eliminating duplicate records

Eliminating duplicate records

I'm using the LOAD DATA command to import a csv file.
I realize that on an indexed field, I have the option of either IGNORE or REPLACE on the load, but I need to be able to produce a list of which records (emails in this case) were duplicates.
We are in the process of converting to MySql from Access, and since MySql does not support nested select statements, the following code no longer works...

WHERE A.id <> 1
AND A.id <> (SELECT max(id) from TABLE)
AND id > (SELECT min(id) from TABLE B Where A.email = B.email AND B.id <> 1 AND B.id <> (SELECT max(id) from TABLE))

Anyone have a clue how I can do this efficiently???

RE: Eliminating duplicate records

Or is there a way I can select all duplicate records from a table with MySql? (some kind of opposite distinct trick or something :))

I'm absolutely lost.

Any help would be greatly appreciated.

RE: Eliminating duplicate records

Try using a self-join to query the table directly.
DevShed.com have a MySQL section on self joins that is quite helpful for this.

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Tek-Tips Forums free from inappropriate posts.
The Tek-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members! Already a Member? Login

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close