/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

1 vote135 views1 answer
Python check if variables are the same
Python
5 votes139 views1 answer
From array to image show
Python
25 votes141 views2 answers
Python copy to clipboard command
Python
4 votes136 views2 answers
Get stock data in python
Python
2 votes132 views1 answer
Print textbox value in tkinter
Python
0 vote147 views1 answer
Exit() function
Python
1 vote152 views1 answer
Python psycopg2 utf8
Python
1 vote146 views1 answer
Palindrome Check using for loop in python
Python
1 vote96 views1 answer
Python ignore return value
Python
0 vote138 views1 answer
How to execute queries with cxoracle python
Python