/Python/Groups the DataFrame using the specified columns

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Similar codes

5 votes167 views1 answer
Python allowed variable caracters
Python
23 votes175 views3 answers
Install django rest_framework
Python
0 vote166 views1 answer
Unique mark boolean django model field
Python
4 votes200 views2 answers
Chrome driver download for selenium python
Python
0 vote176 views1 answer
Can't open file 'sherlock.py' errno 2 no such file or directory
Python
0 vote159 views4 answers
Getting the number of missing values in pandas
Python
0 vote192 views2 answers
Python how to keep turtle window open
Python
0 vote169 views1 answer
PIL Make Circle
Python
6 votes169 views2 answers
AttributeError: type object 'Callable' has no attribute '_abc_registry'
Python
0 vote177 views1 answer
Pymol load coords
Python