/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote98 views1 answer
Possessive in python
Python
0 vote101 views1 answer
Improt kmean
Python
0 vote107 views1 answer
Load url in jupyterlab
Python
7 votes107 views1 answer
Discord.py ban
Python
0 vote115 views1 answer
Histogram for categorical data with plotly
Python
3 votes99 views6 answers
Send embed discord.py
Python
6 votes131 views1 answer
Run py file in another py file
Python
0 vote96 views1 answer
Sphinx, where to write the glossary of a sofware project
Python
1 vote123 views1 answer
Formatting Dates
Python
149 votes177 views6 answers
How to make a random number generator in python
Python