/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

-1 vote200 views1 answer
Kick member discord py
Python
0 vote189 views1 answer
ValueError: unknown is not supported in sklearn.RFECV
Python
0 vote200 views1 answer
Can is slice list with list of indices python
Python
-1 vote185 views1 answer
Numpy make 2d array 1d
Python
2 votes199 views6 answers
Scikit learn
Python
0 vote202 views2 answers
Converting binary to octal in python
Python
0 vote197 views1 answer
HOW TO CREATE A DATETIME LIST QUICK
Python
17 votes213 views1 answer
Sudo apt-get install python3-tk not working
Python
2 votes182 views1 answer
Print all keys having same value
Python
0 vote198 views1 answer
Dict map()
Python