/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote226 views1 answer
Djangodebug toolbar not showing
Python Django
0 vote263 views1 answer
Pandas dexcribe only one column
Python
8 votes210 views1 answer
How to run python in atom
Python
12 votes190 views1 answer
Make a zero list python
Python
0 vote192 views3 answers
Django custom authentication
Python
3 votes181 views6 answers
Django login
Python
0 vote207 views1 answer
Else statement python list comprehension
Python
1 vote275 views1 answer
Replace none with empty string python
Python
2 votes227 views5 answers
Pandas rename single column
Python
0 vote184 views1 answer
Del(list) python
Python