Python Forum
Read csv file with inconsistent delimiter
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Read csv file with inconsistent delimiter
#3
To fix you need to identify when a linefeed is not the end of a row, but a continuation of the description. You could look " - " at the start of the "Release_Date" to find the continuations. If the Overivew is "NaN" append the description to the previous description. If the Overview is a number, use the Overview, Popularity, Vote_Count, Vote_Average, and Original_Language as the Popularity, Vote_Count, Vote_Average, Original_Language and Genre for the row. Even then you still have that odd link after genre. Quite complicated.

Or you could just fix whatever is generating these files and have it place quotes around the Title and Overview. I edited your csv file and wrapped all the titles and Overviews in quotes. I left the linefeeds in the pixie bakeoff description and deleted the link after the pixie bakeoff genre (Animaged) as well as all the commas that were added to the csv file because you did not have quotes on the Overview. The modified csv file reads fine.
gracenz likes this post
Reply


Messages In This Thread
RE: Read csv file with inconsistent delimiter - by deanhystad - Mar-27-2023, 08:59 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  How to read a file as binary or hex "string" so that I can do regex search? tatahuft 3 1,038 Dec-19-2024, 11:57 AM
Last Post: snippsat
  Read TXT file in Pandas and save to Parquet zinho 2 1,236 Sep-15-2024, 06:14 PM
Last Post: zinho
  Pycharm can't read file Genericgamemaker 5 1,568 Jul-24-2024, 08:10 PM
Last Post: deanhystad
  Python is unable to read file Genericgamemaker 13 3,659 Jul-19-2024, 06:42 PM
Last Post: snippsat
  Connecting to Remote Server to read contents of a file ChaitanyaSharma 1 3,280 May-03-2024, 07:23 AM
Last Post: Pedroski55
  Recommended way to read/create PDF file? Winfried 3 4,685 Nov-26-2023, 07:51 AM
Last Post: Pedroski55
  python Read each xlsx file and write it into csv with pipe delimiter mg24 4 3,813 Nov-09-2023, 10:56 AM
Last Post: mg24
  read file txt on my pc to telegram bot api Tupa 0 2,582 Jul-06-2023, 01:52 AM
Last Post: Tupa
  parse/read from file seperated by dots giovanne 5 2,239 Jun-26-2023, 12:26 PM
Last Post: DeaD_EyE
  Formatting a date time string read from a csv file DosAtPython 5 4,962 Jun-19-2023, 02:12 PM
Last Post: DosAtPython

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020