Python Forum
When I read csv file i am getting b'Skipping line messages
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
When I read csv file i am getting b'Skipping line messages
#1
Hi,
I read a csv file, so it reads and i can make something on it there is no problem for this. But I get lots of b'Skipping line messages. I don't want to see them.


data1 = pd.read_csv('../input/mta_1708.csv', error_bad_lines= False)
data1.head()
Error:
b'Skipping line 3356: expected 17 fields, saw 18\n' b'Skipping line 59440: expected 17 fields, saw 18\nSkipping line 61296: expected 17 fields, saw 18\n' b'Skipping line 66068: expected 17 fields, saw 18\nSkipping line 75328: expected 17 fields, saw 18\nSkipping line 81683: expected 17 fields, saw 18\nSkipping line 98179: expected 17 fields, saw 18\n' b'Skipping line 116273: expected 17 fields, saw 18\n' b'Skipping line 133094: expected 17 fields, saw 18\nSkipping line 137887: expected 17 fields, saw 18\nSkipping line 152688: expected 17 fields, saw 18\nSkipping line 160593: expected 17 fields, saw 18\n' b'Skipping line 168801: expected 17 fields, saw 18\nSkipping line 170953: expected 17 fields, saw 18\nSkipping line 179203: expected 17 fields, saw 18\n' b'Skipping line 201585: expected 17 fields, saw 18\nSkipping line 210727: expected 17 fields, saw 18\n' b'Skipping line 289132: expected 17 fields, saw 18\n' b'Skipping line 310840: expected 17 fields, saw 18\nSkipping line 311549: expected 17 fields, saw 18\nSkipping line 312390: expected 17 fields, saw 18\nSkipping line 314081: expected 17 fields, saw 18\nSkipping line 314889: expected 17 fields, saw 18\nSkipping line 319440: expected 17 fields, saw 18\n' b'Skipping line 333414: expected 17 fields, saw 18\nSkipping line 349055: expected 17 fields, saw 18\nSkipping line 354958: expected 17 fields, saw 18\nSkipping line 359424: expected 17 fields, saw 18\n' b'Skipping line 363802: expected 17 fields, saw 18\nSkipping line 371238: expected 17 fields, saw 18\nSkipping line 383152: expected 17 fields, saw 18\n' b'Skipping line 394619: expected 17 fields, saw 18\nSkipping line 396038: expected 17 fields, saw 18\nSkipping line 425194: expected 17 fields, saw 18\n' b'Skipping line 436049: expected 17 fields, saw 18\n' b'Skipping line 492943: expected 17 fields, saw 18\n' b'Skipping line 560824: expected 17 fields, saw 18\nSkipping line 562108: expected 17 fields, saw 18\nSkipping line 564761: expected 17 fields, saw 18\nSkipping line 565173: expected 17 fields, saw 18\nSkipping line 568567: expected 17 fields, saw 18\nSkipping line 576092: expected 17 fields, saw 18\n' b'Skipping line 601641: expected 17 fields, saw 18\nSkipping line 606331: expected 17 fields, saw 18\nSkipping line 618797: expected 17 fields, saw 18\nSkipping line 622388: expected 17 fields, saw 18\n' b'Skipping line 634488: expected 17 fields, saw 18\nSkipping line 649182: expected 17 fields, saw 18\nSkipping line 649962: expected 17 fields, saw 18\n' b'Skipping line 665948: expected 17 fields, saw 18\nSkipping line 671144: expected 17 fields, saw 18\nSkipping line 679474: expected 17 fields, saw 18\nSkipping line 682011: expected 17 fields, saw 18\n' b'Skipping line 691142: expected 17 fields, saw 18\nSkipping line 704452: expected 17 fields, saw 18\nSkipping line 706649: expected 17 fields, saw 18\nSkipping line 707852: expected 17 fields, saw 18\n' b'Skipping line 775405: expected 17 fields, saw 18\nSkipping line 781016: expected 17 fields, saw 18\n' b'Skipping line 797923: expected 17 fields, saw 18\nSkipping line 803890: expected 17 fields, saw 18\nSkipping line 815444: expected 17 fields, saw 18\n' b'Skipping line 831771: expected 17 fields, saw 18\nSkipping line 837856: expected 17 fields, saw 18\nSkipping line 842081: expected 17 fields, saw 18\nSkipping line 843611: expected 17 fields, saw 18\nSkipping line 844886: expected 17 fields, saw 18\nSkipping line 848631: expected 17 fields, saw 18\nSkipping line 851227: expected 17 fields, saw 18\n'
Reply
#2
Your image link does not work. Anyway, don't post images, copy/paste code, output, traceback, etc. and use respective tags when post here.

Please, use proper tags when post code, traceback, output, etc.
See BBcode help for more info.

Please, read What NOT to include in a post
If you can't explain it to a six year old, you don't understand it yourself, Albert Einstein
How to Ask Questions The Smart Way: link and another link
Create MCV example
Debug small programs

Reply
#3
Sorry, I have edited.
Reply
#4
you pass error_bad_line=False so it does not raise error, but issue a warning.
If you want to silence the warning, you need also pass warn_bad_lines=False

From the docs Wrote:error_bad_lines : bool, default True
Lines with too many fields (e.g. a csv line with too many commas) will by default cause an exception to be raised, and no DataFrame will be returned. If False, then these “bad lines” will dropped from the DataFrame that is returned.

warn_bad_lines : bool, default True,
If error_bad_lines is False, and warn_bad_lines is True, a warning for each “bad line” will be output.
If you can't explain it to a six year old, you don't understand it yourself, Albert Einstein
How to Ask Questions The Smart Way: link and another link
Create MCV example
Debug small programs

Reply
#5
Thank you so much.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  File loop curiously skipping files - FIXED mbk34 10 685 Feb-10-2024, 07:08 AM
Last Post: buran
  Recommended way to read/create PDF file? Winfried 3 2,784 Nov-26-2023, 07:51 AM
Last Post: Pedroski55
  python Read each xlsx file and write it into csv with pipe delimiter mg24 4 1,308 Nov-09-2023, 10:56 AM
Last Post: mg24
  read file txt on my pc to telegram bot api Tupa 0 1,048 Jul-06-2023, 01:52 AM
Last Post: Tupa
  parse/read from file seperated by dots giovanne 5 1,043 Jun-26-2023, 12:26 PM
Last Post: DeaD_EyE
  Formatting a date time string read from a csv file DosAtPython 5 1,161 Jun-19-2023, 02:12 PM
Last Post: DosAtPython
  How do I read and write a binary file in Python? blackears 6 6,015 Jun-06-2023, 06:37 PM
Last Post: rajeshgk
  Read csv file with inconsistent delimiter gracenz 2 1,140 Mar-27-2023, 08:59 PM
Last Post: deanhystad
  Python Serial: How to read the complete line to insert to MySQL? sylar 1 781 Mar-21-2023, 10:06 PM
Last Post: deanhystad
  File "<string>", line 19, in <module> error is related to what? Frankduc 9 12,392 Mar-09-2023, 07:22 AM
Last Post: LocklearSusan

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020