/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

1 vote131 views1 answer
Program for right rotation of array in python
Python
0 vote265 views1 answer
Example of django template for forms
Python Django
0 vote172 views2 answers
Count specific instances in a columb in pandas
Python
31 votes178 views2 answers
Matplotlib 3.0.3 wheel file
Python
0 vote271 views1 answer
Python print stderr
Python
0 vote178 views1 answer
Python get screen size raspberry pi
Python
39 votes168 views6 answers
Python float precision
Python
0 vote181 views1 answer
Division of 2 numbers in python
Python
1 vote176 views1 answer
Best Python Free Tutorial
Python
11 votes180 views2 answers
How to create progress bar python
Python