pyspark help

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Thread Modes

pyspark help

lokesh
Programmer named Tim

Posts: 11

Threads: 8

Joined: May 2019

Reputation: 0

Jan-03-2023, 04:34 PM

Hi,

I need a help to convert this pandas df to pyspark dataframe

df=df.groupby('key', as_index=False).agg({'key' : 'first', 'country' : ', '.join})

Appreciate your help/guidance on this.

Thanks,
Lokesh

Find

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	PySpark Coding Challenge	cpatte7372	4	6,113	Jun-25-2023, 12:56 PM Last Post: prajwal_0078
	Pyspark dataframe	siddhi1919	3	1,233	Apr-25-2023, 12:39 PM Last Post: snippsat
	How to iterate Groupby in Python/PySpark	DrData82	2	2,848	Feb-05-2022, 09:59 PM Last Post: DrData82
	PySpark Equivalent Code	cpatte7372	0	1,269	Jan-14-2022, 08:59 PM Last Post: cpatte7372
	Pyspark - my code works but I want to make it better	Kevin	1	1,797	Dec-01-2021, 05:04 AM Last Post: Kevin
	pyspark parallel write operation not working	aliyesami	1	1,705	Oct-16-2021, 05:18 PM Last Post: aliyesami
	pyspark creating temp files in /tmp folder	aliyesami	1	5,026	Oct-16-2021, 05:15 PM Last Post: aliyesami
	KafkaUtils module not found on spark 3 pyspark	aupres	2	7,399	Feb-17-2021, 09:40 AM Last Post: Larz60+
	pyspark dataframe to json without header	vijz	0	1,964	Nov-28-2020, 05:36 PM Last Post: vijz
	Pyspark SQL Error - mismatched input 'FROM' expecting <EOF>	Ariean	3	48,113	Nov-20-2020, 03:49 PM Last Post: Ariean

Users browsing this thread: 1 Guest(s)

View a Printable Version

pyspark help

User Panel Messages

Announcements