/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

56 votes128 views3 answers
Python online compiler 3.7
Python
1 vote135 views1 answer
Liste in python
Python
0 vote147 views1 answer
Xlrd documentation
Python
0 vote118 views1 answer
How to query json field django
Python
7 votes214 views1 answer
Health definition
Python
0 vote136 views1 answer
Python keyborad back space
Python
0 vote147 views1 answer
How to replace special characters in a string python
Python
0 vote115 views1 answer
Frontmost flag qt
Python
0 vote135 views1 answer
Adding new column to existing DataFrame in Pandas using concat method
Python
0 vote128 views1 answer
Pandas drop row from a list of vlaue
Python