/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

8 votes184 views3 answers
Len python
Python
0 vote190 views1 answer
Newtorkx remove node
Python
0 vote199 views1 answer
Python click activator
Python
1 vote225 views1 answer
Sum values in django models
Python Django
4 votes150 views1 answer
Python max float
Python
0 vote193 views1 answer
Selecting a specific value and corrersponding value in df python
Python
1 vote242 views1 answer
Vsc python close all functions
Python
22 votes229 views3 answers
How to get tomorrow date in python
Python
0 vote189 views1 answer
Calculer un temps en python
Python
1 vote235 views1 answer
Django queryset group by count
Python Django