Python Forum
Handling multiple errors when using datafiles in Pandas
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Handling multiple errors when using datafiles in Pandas
#2
It is hard to say something without further details, e.g. Does your data frame include missed values, are all values presented in the same format (coordinates might be presented as strings, e.g. in format dd.ddddddd (decimal degrees) or
dddd mmm ssss (degrees, minutes and seconds)) or something else?

250k locations is not too much. You are likely needed to use some regular expressions, not sure.
You can do all this conversion in one pass, e.g. consider using .apply method of a df-instance. You will need to write your own function to be applied. Hope that helps.
Could you provide subsample of your data?
Reply


Messages In This Thread
RE: Handling multiple errors when using datafiles in Pandas - by scidam - Jul-16-2019, 03:17 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Import multiple CSV files into pandas Krayna 0 1,717 May-20-2021, 04:56 PM
Last Post: Krayna
  pandas str.extract multiple regex groups with OR pythonidae 2 7,883 Dec-19-2019, 05:43 PM
Last Post: pythonidae
  Reading Multiple Sheets using Pandas dhiliptcs 1 4,045 Sep-30-2019, 11:26 PM
Last Post: scidam

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020