/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote173 views1 answer
Ptyhton json respones
Python
1 vote177 views2 answers
Format date field in pandas
Python
0 vote159 views1 answer
Python remove all unicode from string
Python
4 votes173 views1 answer
Bold text variable in python
Python
0 vote162 views1 answer
SystemError: <class 'cv2.CascadeClassifier'> returned a result with an error set
Python
6 votes154 views1 answer
Change dataframe value by index
Python
0 vote150 views1 answer
Concat with zero array numpy
Python
1 vote159 views1 answer
Python sum of list axes
Python
-1 vote208 views1 answer
Regex find all sentences python
Python
0 vote228 views1 answer
Nth catalan number
Python