/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote110 views1 answer
Python anonymous function
Python
0 vote120 views2 answers
Dice Roller in Python
Python
1 vote80 views1 answer
Python ignore return value
Python
12 votes132 views2 answers
Python how to return max num index
Python
3 votes133 views1 answer
Drop duplicates pandas first column
Python
0 vote124 views1 answer
Paschat opposite sanskrit
Python
0 vote123 views1 answer
Saree
Python
0 vote118 views1 answer
Get full detail inside of id in django rest framework many to many
Python
0 vote124 views1 answer
Cv2 assertion failed
Python
0 vote115 views1 answer
Scrapy access settings from spider
Python