Python Forum
finding dupes (with a twist)
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
finding dupes (with a twist)
#17
Ah, my mistake

import pandas as pd 
 
df_dupes = pd.read_csv('dupes.csv') # dupes
dfe = pd.read_csv('exceptions.csv') # the exceptions
# make sure email is lower case
df_dupes['Email'] = df_dupes['Email'].apply(lambda x: x.lower())
dfe['Email'] = dfe['Email'].apply(lambda x: x.lower())

# get just the records from dupes where email not in exceptions
df_clean = df_dupes[~df_dupes['Email'].isin(dfe['Email'])]
print(df_clean)
If you can't explain it to a six year old, you don't understand it yourself, Albert Einstein
How to Ask Questions The Smart Way: link and another link
Create MCV example
Debug small programs

Reply


Messages In This Thread
finding dupes (with a twist) - by Lyle - Apr-28-2020, 09:51 PM
RE: finding dupes (with a twist) - by stullis - Apr-28-2020, 10:02 PM
RE: finding dupes (with a twist) - by Lyle - Apr-28-2020, 10:11 PM
RE: finding dupes (with a twist) - by buran - Apr-29-2020, 04:16 AM
RE: finding dupes (with a twist) - by Lyle - Apr-29-2020, 11:28 PM
RE: finding dupes (with a twist) - by buran - Apr-30-2020, 03:25 AM
RE: finding dupes (with a twist) - by Lyle - Apr-30-2020, 07:36 PM
RE: finding dupes (with a twist) - by Lyle - May-09-2020, 12:29 AM
RE: finding dupes (with a twist) - by Lyle - May-11-2020, 10:48 PM
RE: finding dupes (with a twist) - by buran - May-12-2020, 04:51 AM
RE: finding dupes (with a twist) - by Lyle - May-13-2020, 12:07 AM
RE: finding dupes (with a twist) - by Lyle - May-24-2020, 08:10 PM
RE: finding dupes (with a twist) - by buran - May-24-2020, 08:33 PM
RE: finding dupes (with a twist) - by Lyle - May-25-2020, 12:18 AM
RE: finding dupes (with a twist) - by buran - May-25-2020, 05:44 AM
RE: finding dupes (with a twist) - by Lyle - May-25-2020, 03:42 PM
RE: finding dupes (with a twist) - by buran - May-25-2020, 04:29 PM
RE: finding dupes (with a twist) - by Lyle - May-25-2020, 05:01 PM
RE: finding dupes (with a twist) - by buran - May-25-2020, 05:09 PM
RE: finding dupes (with a twist) - by Lyle - May-28-2020, 06:00 PM
RE: finding dupes (with a twist) - by buran - May-28-2020, 06:19 PM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020