/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote113 views1 answer
Python library automatic sort
Python
2 votes107 views3 answers
If string contains list of letters python
Python
0 vote109 views1 answer
Convert string input into a nested tuple in python
Python
0 vote111 views1 answer
Python advanced programming exercises
Python
16 votes111 views2 answers
Abs function in python
Python
1 vote116 views1 answer
Isnull().mean() python
Python
22 votes107 views4 answers
How to remove the last item in a list python
Python
1 vote113 views1 answer
Intersection of dataframes based on column
Python
2 votes115 views1 answer
How to print palindrome in 100 between 250 in python
Python
0 vote106 views1 answer
Python not showing in control panel but showing not installed
Python