/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

4 votes116 views2 answers
Python mkdir
Python
5 votes111 views2 answers
Columns to dictionary pandas
Python
0 vote115 views1 answer
How to get the time zones in python
Python
6 votes100 views1 answer
Python how to read a xlsx file
Python
6 votes109 views2 answers
Pandas count rows in column
Python
1 vote99 views2 answers
Python dataframe remove header
Python
1 vote105 views1 answer
Instal cython
Python
1 vote113 views1 answer
Get local python api image url
Python
0 vote112 views1 answer
How to convert the date column from string to a particular format in python
Python
179 votes185 views10 answers
Minecraft
Python