/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

1 vote124 views1 answer
Python custom class indexing
Python
0 vote121 views1 answer
Python pie chart with legend
Python
7 votes107 views4 answers
Python possible combinations
Python
0 vote103 views1 answer
How to save a python object in a file
Python
0 vote108 views1 answer
Python session set cookies
Python
0 vote96 views2 answers
Concatenate the squares of numbers in python
Python
1 vote123 views2 answers
How to 404 custom page not found in django
Python
0 vote112 views1 answer
Bracket balanced or not in python
Python
1 vote109 views2 answers
Round python print
Python
0 vote153 views1 answer
Enumerate in django templte
Python Django