/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

5 votes152 views1 answer
Python start simplehttpserver
Python
1 vote215 views1 answer
Flask api with parameter
Python Flask
2 votes158 views1 answer
Change pygame window title
Python
3 votes157 views2 answers
Socket io python
Python
3 votes171 views3 answers
2d array python initialize
Python
12 votes166 views2 answers
Python pip version check
Python
0 vote164 views1 answer
Read text file line by line using the readline() function
Python
3 votes157 views2 answers
Tables in python
Python
3 votes162 views2 answers
Install decouple python
Python
0 vote151 views1 answer
Ist und ein satzglied
Python