Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!
  • Students Click Here

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here


.readline() crashes while processing text file

.readline() crashes while processing text file

.readline() crashes while processing text file

I have systems that generate log-files daily and it's full of useless data. I wrote a python script that weeds out what I need. Based on user input, it goes through files, examines the file line by line (readline()) and if it matches certain criteria, the given line is then written into a separate text file.
However, there appears to be a certain type of character that crashes the program.
The error message I get is

UnicodeDecodeError: 'utf16' codec can't decode bytes in position 70-71: unexpected end of data

When I open the file with Notepad ++, I see the attached.

When I use the readline() with Try:, then the program doesn't crash, it actually bypasses some of these errors, but most of the time it hangs.

Currently the only way I can use this program is to run it, see where it crashes, manually remove the pictured characters, and run the program again, and when it crashes, manually... etc. etc, etc. Very time-consuming...

Any idea?

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Tek-Tips Forums free from inappropriate posts.
The Tek-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members!

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close