/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

7 votes208 views1 answer
Pandas insert column in the beginning
Python
4 votes303 views1 answer
Plt add axis name
Python
0 vote186 views1 answer
How to get values in each cluster
Python
0 vote225 views1 answer
Tb to pb with python calculator
Python
0 vote254 views1 answer
Disable console messages in Flask server
Python Flask
0 vote206 views1 answer
ModelCheckpoint
Python
1 vote206 views1 answer
Can list comprehenios contain else
Python
0 vote214 views1 answer
Binary Search Tree
Python
0 vote200 views1 answer
Sklearn model persistence
Python
0 vote232 views1 answer
Django create username and password from csv
Python Django