/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

133 votes182 views6 answers
Input function in python
Python
7 votes168 views1 answer
How to get user location in python
Python
1 vote208 views1 answer
Find all element in list python
Python
0 vote172 views1 answer
Py tuple
Python
17 votes189 views2 answers
Python calculate factorial
Python
1 vote182 views1 answer
Render_template not showing images
Python
0 vote179 views1 answer
Mysql pyzo
Python
19 votes189 views1 answer
Error tokenizing data. c error
Python
82 votes183 views6 answers
Arch Linux
Python
3 votes297 views3 answers
Flask migrate
Python Flask