/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

1 vote150 views1 answer
Data Compression in python
Python
1 vote165 views1 answer
Python sleep random
Python
9 votes169 views6 answers
Python text to speech
Python
0 vote156 views1 answer
Nested ternary operator python
Python
4 votes156 views2 answers
Flask get variable from url
Python
0 vote149 views1 answer
Take screenshot of video python
Python
0 vote146 views1 answer
Openai python
Python
0 vote155 views2 answers
Access column pandas
Python
3 votes150 views1 answer
Python simple web app
Python
0 vote159 views9 answers
Filter dataframe site:stackoverflow.com
Python