/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

0 vote123 views3 answers
Split credit card number python
Python
0 vote132 views1 answer
Conversion of int to a specified base number
Python
2 votes140 views3 answers
Miles to km in python
Python
-1 vote133 views1 answer
Import csv from google drive python
Python
0 vote138 views1 answer
Python String with Alphanumeric characters
Python
0 vote147 views1 answer
Video steganography using python
Python
0 vote141 views1 answer
Python assert is not null
Python
6 votes158 views5 answers
How to redirect in django
Python Django
2 votes189 views1 answer
Setting a condition for perfect square in python
Python
0 vote130 views1 answer
Can 2020 get any worse
Python