/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote132 views1 answer
Easygui text adventure in python 3
Python
2 votes128 views3 answers
Split string by length python
Python
1 vote128 views1 answer
Python get current number of threads
Python
1 vote145 views1 answer
How to make a pairs plot with pandas
Python
0 vote116 views1 answer
Switch between frames in tkinter
Python
1 vote145 views1 answer
Pyhton turtle delete
Python
1 vote127 views1 answer
Sort array python by column
Python
0 vote133 views1 answer
Supercharged python
Python
0 vote130 views1 answer
Operation that returns True if all values are equal
Python
0 vote137 views4 answers
Python to php
Python