/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

2 votes247 views1 answer
Jinja inheritance
Python
0 vote201 views1 answer
AttributeError: module 'pyarrow' has no attribute 'parquet'
Python
0 vote183 views1 answer
Sinusoidal regression python
Python
0 vote195 views1 answer
Pandas get day names
Python
35 votes193 views5 answers
How to use replace in python
Python
0 vote205 views1 answer
Python program for getting url, hostname, port numbers
Python
1 vote139 views1 answer
Pandas subtract columns
Python
-1 vote175 views1 answer
Matplotlib limit number of ticks
Python
0 vote168 views1 answer
Convert excel workbook to dataframe
Python
0 vote176 views1 answer
Python difference between consecutive element in list
Python