/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

1 vote124 views1 answer
Python pipe
Python
0 vote142 views1 answer
Set a Widget size to the parent size from python in kivy
Python
-1 vote142 views1 answer
Sort dict based on other list
Python
0 vote128 views1 answer
Scrape email in a list from website python
Python
0 vote154 views1 answer
Python dlib
Python
0 vote122 views1 answer
Import combination
Python
0 vote154 views1 answer
Eager tensor to numpy
Python
0 vote136 views1 answer
Example of Ternary Operator in Python
Python
1 vote125 views1 answer
Pd combine series
Python
1 vote130 views1 answer
$ sudo pip install pdml2flow-frame-inter-arrival-time
Python