/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

1 vote140 views4 answers
Python 2.7 venv
Python
22 votes132 views5 answers
Select rows with nan pandas
Python
0 vote140 views1 answer
Access twitter api using tweepy in python
Python
0 vote152 views1 answer
Hierarchy dendrogram
Python
0 vote143 views1 answer
How delete element from list python
Python
1 vote136 views1 answer
GdScript onready
Python
0 vote139 views1 answer
Multipart/form data multipart encoder python
Python
3 votes143 views1 answer
Maping value to data in pandas dataframe
Python
2 votes148 views1 answer
How to get the last value in a list python
Python
2 votes143 views1 answer
Find element by title selenium python
Python