/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote129 views1 answer
Initialize dictionary to zero in python
Python
0 vote118 views1 answer
Does the queen brush her teeth
Python
0 vote120 views1 answer
No python application found, check your startup logs for errors
Python
3 votes109 views6 answers
Python variable
Python
1 vote112 views1 answer
Flask clear session
Python
0 vote121 views1 answer
Loop append to list python
Python
0 vote141 views1 answer
Pygame check collision
Python
2 votes107 views3 answers
How to do speed test with python
Python
-1 vote116 views1 answer
Jupyter notebook show full dataframe cell
Python
0 vote111 views1 answer
Assert vs validate in python
Python