/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote242 views1 answer
Read tar.gz file python
Python
0 vote196 views1 answer
Python wifi moudel [WinError 2] The system cannot find the file specified
Python
0 vote189 views1 answer
Save this RDD as a SequenceFile of serialized objects
Python
3 votes274 views2 answers
How to install terminal in atom
Python
0 vote175 views1 answer
Read large SAS file ilarger than memory n Python
Python
3 votes211 views1 answer
How to find the multiples of a number in python
Python
0 vote176 views1 answer
Pandas gropu by
Python
0 vote273 views1 answer
How to make python open a program/desktop app
Python
16 votes201 views3 answers
Python get all file names in a dir
Python
1 vote199 views1 answer
Pyspark take random sample
Python