Python Forum

Full Version: When I read csv file i am getting b'Skipping line messages
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Hi,
I read a csv file, so it reads and i can make something on it there is no problem for this. But I get lots of b'Skipping line messages. I don't want to see them.


data1 = pd.read_csv('../input/mta_1708.csv', error_bad_lines= False)
data1.head()
Error:
b'Skipping line 3356: expected 17 fields, saw 18\n' b'Skipping line 59440: expected 17 fields, saw 18\nSkipping line 61296: expected 17 fields, saw 18\n' b'Skipping line 66068: expected 17 fields, saw 18\nSkipping line 75328: expected 17 fields, saw 18\nSkipping line 81683: expected 17 fields, saw 18\nSkipping line 98179: expected 17 fields, saw 18\n' b'Skipping line 116273: expected 17 fields, saw 18\n' b'Skipping line 133094: expected 17 fields, saw 18\nSkipping line 137887: expected 17 fields, saw 18\nSkipping line 152688: expected 17 fields, saw 18\nSkipping line 160593: expected 17 fields, saw 18\n' b'Skipping line 168801: expected 17 fields, saw 18\nSkipping line 170953: expected 17 fields, saw 18\nSkipping line 179203: expected 17 fields, saw 18\n' b'Skipping line 201585: expected 17 fields, saw 18\nSkipping line 210727: expected 17 fields, saw 18\n' b'Skipping line 289132: expected 17 fields, saw 18\n' b'Skipping line 310840: expected 17 fields, saw 18\nSkipping line 311549: expected 17 fields, saw 18\nSkipping line 312390: expected 17 fields, saw 18\nSkipping line 314081: expected 17 fields, saw 18\nSkipping line 314889: expected 17 fields, saw 18\nSkipping line 319440: expected 17 fields, saw 18\n' b'Skipping line 333414: expected 17 fields, saw 18\nSkipping line 349055: expected 17 fields, saw 18\nSkipping line 354958: expected 17 fields, saw 18\nSkipping line 359424: expected 17 fields, saw 18\n' b'Skipping line 363802: expected 17 fields, saw 18\nSkipping line 371238: expected 17 fields, saw 18\nSkipping line 383152: expected 17 fields, saw 18\n' b'Skipping line 394619: expected 17 fields, saw 18\nSkipping line 396038: expected 17 fields, saw 18\nSkipping line 425194: expected 17 fields, saw 18\n' b'Skipping line 436049: expected 17 fields, saw 18\n' b'Skipping line 492943: expected 17 fields, saw 18\n' b'Skipping line 560824: expected 17 fields, saw 18\nSkipping line 562108: expected 17 fields, saw 18\nSkipping line 564761: expected 17 fields, saw 18\nSkipping line 565173: expected 17 fields, saw 18\nSkipping line 568567: expected 17 fields, saw 18\nSkipping line 576092: expected 17 fields, saw 18\n' b'Skipping line 601641: expected 17 fields, saw 18\nSkipping line 606331: expected 17 fields, saw 18\nSkipping line 618797: expected 17 fields, saw 18\nSkipping line 622388: expected 17 fields, saw 18\n' b'Skipping line 634488: expected 17 fields, saw 18\nSkipping line 649182: expected 17 fields, saw 18\nSkipping line 649962: expected 17 fields, saw 18\n' b'Skipping line 665948: expected 17 fields, saw 18\nSkipping line 671144: expected 17 fields, saw 18\nSkipping line 679474: expected 17 fields, saw 18\nSkipping line 682011: expected 17 fields, saw 18\n' b'Skipping line 691142: expected 17 fields, saw 18\nSkipping line 704452: expected 17 fields, saw 18\nSkipping line 706649: expected 17 fields, saw 18\nSkipping line 707852: expected 17 fields, saw 18\n' b'Skipping line 775405: expected 17 fields, saw 18\nSkipping line 781016: expected 17 fields, saw 18\n' b'Skipping line 797923: expected 17 fields, saw 18\nSkipping line 803890: expected 17 fields, saw 18\nSkipping line 815444: expected 17 fields, saw 18\n' b'Skipping line 831771: expected 17 fields, saw 18\nSkipping line 837856: expected 17 fields, saw 18\nSkipping line 842081: expected 17 fields, saw 18\nSkipping line 843611: expected 17 fields, saw 18\nSkipping line 844886: expected 17 fields, saw 18\nSkipping line 848631: expected 17 fields, saw 18\nSkipping line 851227: expected 17 fields, saw 18\n'
Your image link does not work. Anyway, don't post images, copy/paste code, output, traceback, etc. and use respective tags when post here.

Please, use proper tags when post code, traceback, output, etc.
See BBcode help for more info.

Please, read What NOT to include in a post
Sorry, I have edited.
you pass error_bad_line=False so it does not raise error, but issue a warning.
If you want to silence the warning, you need also pass warn_bad_lines=False

From the docs Wrote:error_bad_lines : bool, default True
Lines with too many fields (e.g. a csv line with too many commas) will by default cause an exception to be raised, and no DataFrame will be returned. If False, then these “bad lines” will dropped from the DataFrame that is returned.

warn_bad_lines : bool, default True,
If error_bad_lines is False, and warn_bad_lines is True, a warning for each “bad line” will be output.
Thank you so much.