Pandas groupby

data.groupby('month', as_index=False).agg({"duration": "sum"})

Source: shanelynn.ie

Pandas new df from groupby

df = pd.DataFrame(old_df.groupby(['groupby_attribute'])['mean_attribute'].mean())
df = df.reset_index()
df

Groups the DataFrame using the specified columns

# Groups the DataFrame using the specified columns

df.groupBy().avg().collect()
# [Row(avg(age)=3.5)]
sorted(df.groupBy('name').agg({'age': 'mean'}).collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(df.name).avg().collect())
# [Row(name='Alice', avg(age)=2.0), Row(name='Bob', avg(age)=5.0)]
sorted(df.groupBy(['name', df.age]).count().collect())
# [Row(name='Alice', age=2, count=1), Row(name='Bob', age=5, count=1)]

Source: spark.apache.org

Groupby as_index=false

When you use as_index=False , you indicate to groupby() that you don't want to set the column ID as the index (duh!). ... Using as_index=True allows you to apply a sum over axis=1 without specifying the names of the columns, then summing the value over axis 0.

Pandas groupby

>>> emp.groupby(['dept', 'gender']).agg({'salary':'mean'}).round(-3)

Source: medium.com

Pandas groupby

# usage example
gb = df.groupby(["col1", "col2"])
counts = gb.size().to_frame(name="counts")
count
(
    counts.join(gb.agg({"col3": "mean"}).rename(columns={"col3": "col3_mean"}))
    .join(gb.agg({"col4": "median"}).rename(columns={"col4": "col4_median"}))
    .join(gb.agg({"col4": "min"}).rename(columns={"col4": "col4_min"}))
    .reset_index()
)

# to create dataframe
keys = np.array(
    [
        ["A", "B"],
        ["A", "B"],
        ["A", "B"],
        ["A", "B"],
        ["C", "D"],
        ["C", "D"],
        ["C", "D"],
        ["E", "F"],
        ["E", "F"],
        ["G", "H"],
    ]
)



df = pd.DataFrame(
    np.hstack([keys, np.random.randn(10, 4).round(2)]), columns=["col1", "col2", "col3", "col4", "col5", "col6"]
)
df[["col3", "col4", "col5", "col6"]] = df[["col3", "col4", "col5", "col6"]].astype(float)

Source: stackoverflow.com

Similar codes

0 vote139 views1 answer
Cvhaardetectobjects
Python
43 votes137 views5 answers
Pandas iterrows
Python
31 votes139 views3 answers
How to add one to the index of a list
Python
0 vote162 views1 answer
Candle stick with volume plotly
Python
1 vote149 views1 answer
Plotly line plot
Python
0 vote139 views1 answer
Programe to find contagious sum of sequence
Python
0 vote185 views1 answer
Change creation date filesystem py
Python
0 vote105 views9 answers
Django.core.mail.backends.console.emailbackend
Python
0 vote182 views1 answer
Type object 'SparkContext' has no attribute '_jsc'
Python
0 vote141 views1 answer
If the answer satisfiest the condition so how to stop it to run further ahead in python
Python