/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

16 votes129 views1 answer
Which folder python os
Python
0 vote153 views1 answer
How to read json file from s3 bucket into aws glue job
Python
10 votes140 views2 answers
Create dict from json file python
Python
0 vote144 views1 answer
Inverse mask python
Python
1 vote135 views1 answer
Plt.savefig without showing
Python
0 vote136 views1 answer
Matplotlib pie chart move autotext
Python
1 vote137 views1 answer
Conda specify multiple channels
Python
12 votes158 views2 answers
Append file to list python
Python
-1 vote132 views1 answer
Get the largest of 2 strings python
Python
3 votes138 views1 answer
Get common elements from two lists
Python