/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

2 votes115 views1 answer
Resampling data python
Python
0 vote100 views1 answer
Skcuda pip
Python
26 votes99 views1 answer
Shutil move file
Python
0 vote94 views1 answer
Auto instagram login
Python
0 vote125 views1 answer
FIND MISSING NUMBER IN AN ARRAY IN PYTHON
Python
0 vote98 views1 answer
Python time.sleep slow
Python
0 vote97 views1 answer
Demonstrating polymorphism in python class
Python
0 vote91 views1 answer
Python change font in 1 line
Python
0 vote119 views1 answer
Add an element to list python
Python
0 vote93 views1 answer
Custom-field-list_display
Python