/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote132 views1 answer
Generate all combinatinosrs of a list pyton
Python
1 vote148 views1 answer
Apolatrix
Python
1 vote119 views1 answer
Dictionary with double key python
Python
11 votes112 views3 answers
Twitter bot python
Python
52 votes125 views6 answers
Python remove string from string
Python
3 votes117 views9 answers
Creating environment variable in python
Python
-1 vote157 views1 answer
Class views django slug
Python Django
0 vote125 views1 answer
Pandas unqiue value each column
Python
0 vote114 views1 answer
Django show image in admin page
Python
0 vote140 views1 answer
Flask google analytics
Python