/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

2 votes198 views1 answer
Use of the word bruh over time
Python
0 vote228 views1 answer
Hacker earth
Python
0 vote238 views1 answer
Networkx path between two nodes
Python
4 votes196 views2 answers
Python selenium implicit wait
Python
1 vote204 views1 answer
How to send a command to cmd using python
Python
0 vote193 views1 answer
Output of an intermediate layer
Python
1 vote199 views2 answers
Code help
Python
-1 vote209 views1 answer
How to code a trading bot in python
Python
17 votes163 views5 answers
Adding the elements of a list in python
Python
14 votes190 views3 answers
Python find difference between lists
Python