drop duplicate values based on a criteria

Thread Rating:

Thread Modes

drop duplicate values based on a criteria

zivoni
Minister of Silly Walks

Team Member

Posts: 331

Threads: 2

Joined: Feb 2017

Reputation: 65

Apr-28-2017, 10:17 AM

It can be done similarly like you could do it with sql with window function (row_number over ordered group and take first).

table['sortcol'] = np.abs(table.Col2)
table.sort('sortcol').groupby('Col1').first()

followed by dropping of sortcol column

Messages In This Thread

RE: drop duplicate values based on a criteria - by zivoni - Apr-28-2017, 10:17 AM

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	update values in one dataframe based on another dataframe - Pandas	iliasb	2	9,733	Aug-14-2021, 12:38 PM Last Post: jefsummers
	Counting Criteria in Pandas Question	Koenig	1	2,257	Sep-30-2019, 05:16 AM Last Post: perfringo
	how to get x values based on y-axis values from curvefit function	python_newbie09	1	3,413	Sep-19-2019, 02:09 AM Last Post: scidam
	Splitting values in column in a pandas dataframe based on a condition	hey_arnold	1	4,274	Jul-24-2018, 02:18 PM Last Post: hey_arnold
	Get max values based on unique values in another list - python	Antonio	8	8,680	Jun-12-2018, 07:49 PM Last Post: Mekire
	Select rows based on a criteria	klllmmm	8	7,918	May-11-2017, 06:58 PM Last Post: klllmmm
	Insert values into a column in the same table based on a criteria	klllmmm	3	4,382	Apr-13-2017, 10:10 AM Last Post: zivoni
	Match two data sets based on item values	klllmmm	7	6,743	Mar-29-2017, 02:33 PM Last Post: zivoni

Users browsing this thread: 1 Guest(s)