/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

7 votes186 views1 answer
Change value in pandas dataframe cell
Python
0 vote228 views1 answer
Lose your django secret key
Python Django
1 vote161 views2 answers
Phi
Python
1 vote332 views1 answer
Pandas shift all columns
Python
5 votes141 views1 answer
How to rezize image in python tkinter
Python
1 vote155 views1 answer
Merge on row number python
Python
0 vote147 views2 answers
Python divide array into n parts
Python
1 vote155 views2 answers
Fast fourier transform python
Python
79 votes147 views6 answers
Python current working directory
Python
0 vote154 views1 answer
Difference between this and super
Python