/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote125 views1 answer
How to use wbtools in python
Python
0 vote133 views1 answer
Pycocotools python3.7
Python
0 vote134 views1 answer
Jaccard distance python
Python
7 votes126 views1 answer
Python primality test
Python
0 vote130 views1 answer
Roganrola
Python
0 vote158 views1 answer
Python fibonacci series (Recursion)
Python
0 vote107 views1 answer
Time df.apply() python
Python
2 votes143 views1 answer
Python IRR calculation
Python
6 votes139 views2 answers
Python get current time in seconds
Python
9 votes143 views2 answers
Clear terminal in python
Python