/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote171 views1 answer
Setting spacing (minor) between ticks in matplotlib
Python
0 vote165 views1 answer
Anvil get last row of data table
Python
1 vote156 views2 answers
Build dataframe from dictionary
Python
0 vote223 views1 answer
Validate delete inline formset django
Python Django
0 vote195 views1 answer
Box Plot in Seaborn
Python
14 votes406 views6 answers
What is flask
Python Flask
10 votes170 views2 answers
Python get numbers after decimal point
Python
0 vote159 views1 answer
Multiclass.roc plot title
Python
2 votes289 views2 answers
How to read a json resposnse from a link in python
Python
2 votes152 views1 answer
Father's day 2020
Python