/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

1 vote136 views1 answer
How to get sheet names in pandas
Python
0 vote171 views1 answer
Django creat app return _bootstrap._gcd_import
Python Django
1 vote174 views1 answer
Number of rows or columns in numpy ndarray python
Python
0 vote190 views1 answer
Ftplib tqdm
Python
0 vote178 views1 answer
Pytho ntoday as string
Python
0 vote183 views1 answer
Python update header row
Python
3 votes232 views1 answer
Flask delete cookie stackoverflow
Python Flask
37 votes171 views6 answers
Count rows with nan pandas
Python
0 vote175 views1 answer
How to set learning rate in keras
Python
0 vote181 views1 answer
Sum() function in Python
Python