INTELLIGENT WORK FORUMS
FOR COMPUTER PROFESSIONALS

Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Jobs

awk code error for removing duplicate records between 2 files

awk code error for removing duplicate records between 2 files

awk code error for removing duplicate records between 2 files

(OP)
I found this bit of awk code that compares the first column of two files and then deletes the duplicate records of the second file.

CODE --> awk

awk 'FNR==NR{a[$1];next};!($1 in a)' file1 file2 > file3 
When I run the code, I get an error that says: ^ invalid char ''' in expression

I am very new to awk coding, so I do not too sure what is causing the error. Any help would be greatly appreciated! Thanks in advance!

RE: awk code error for removing duplicate records between 2 files

Hi

Based on the error message I suppose you are running it on Windows. In that case you could
  • Run it in Cygwin's terminal. There you will benefit of all the Linux shell features, including the possibility to use single quotes ( ' ) as string delimiters.
  • Replace single quote ( ' ) with double quotes ( " ). Not sure, but maybe for this extremely simple code will work.
  • Put all code in a file and pass that to the interpreter :

    CODE --> nodup.awk

    FNR==NR{a[$1];next};!($1 in a) 

    CODE --> command line

    awk -f nodup.awk file1 file2 > file3 
If not, then you will have to give us more details about system, shell and Awk implementation and version.

Feherke.
feherke.ga

RE: awk code error for removing duplicate records between 2 files

(OP)
Yep that worked, Thank you!!

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Tek-Tips Forums free from inappropriate posts.
The Tek-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members!

Resources

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close