Python Forum
finding dupes (with a twist)
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
finding dupes (with a twist)
#12
I'm still at it folks! So I completed the second step by comparing an exceptions file to the dupes file and deleting those exceptions from the main dupes list to create dupes_cleaned.
It's taken two weeks of intense study, and multiple, multiple iterations to finally figure out it took only two lines of code!!! BUT, that intense study means that 1) these lines are MINE and MINE alone! and 2) I understand the theory behind it much better than if I'd just copied someone else's code.
Please let me know if I missed anything or if you would have taken a different approach.
exceptions=pd.read_csv('exceptions.csv')
exceptions['EmailAddress'] = exceptions['EmailAddress'].str.lower()
except_emails=exceptions['EmailAddress']

for e in except_emails:
    df_dupes=df_dupes[(df_dupes['EmailAddress'] != e)]

df_dupes.to_excel('dupes cleaned.xlsx', index = False)
Reply


Messages In This Thread
finding dupes (with a twist) - by Lyle - Apr-28-2020, 09:51 PM
RE: finding dupes (with a twist) - by stullis - Apr-28-2020, 10:02 PM
RE: finding dupes (with a twist) - by Lyle - Apr-28-2020, 10:11 PM
RE: finding dupes (with a twist) - by buran - Apr-29-2020, 04:16 AM
RE: finding dupes (with a twist) - by Lyle - Apr-29-2020, 11:28 PM
RE: finding dupes (with a twist) - by buran - Apr-30-2020, 03:25 AM
RE: finding dupes (with a twist) - by Lyle - Apr-30-2020, 07:36 PM
RE: finding dupes (with a twist) - by Lyle - May-09-2020, 12:29 AM
RE: finding dupes (with a twist) - by Lyle - May-11-2020, 10:48 PM
RE: finding dupes (with a twist) - by buran - May-12-2020, 04:51 AM
RE: finding dupes (with a twist) - by Lyle - May-13-2020, 12:07 AM
RE: finding dupes (with a twist) - by Lyle - May-24-2020, 08:10 PM
RE: finding dupes (with a twist) - by buran - May-24-2020, 08:33 PM
RE: finding dupes (with a twist) - by Lyle - May-25-2020, 12:18 AM
RE: finding dupes (with a twist) - by buran - May-25-2020, 05:44 AM
RE: finding dupes (with a twist) - by Lyle - May-25-2020, 03:42 PM
RE: finding dupes (with a twist) - by buran - May-25-2020, 04:29 PM
RE: finding dupes (with a twist) - by Lyle - May-25-2020, 05:01 PM
RE: finding dupes (with a twist) - by buran - May-25-2020, 05:09 PM
RE: finding dupes (with a twist) - by Lyle - May-28-2020, 06:00 PM
RE: finding dupes (with a twist) - by buran - May-28-2020, 06:19 PM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020