/Python/Impute data by using groupby and transform

Impute data by using groupby and transform

import pandas as pd
from datetime import datetime

def generate_data():
    ...

t = datetime.now()
df = generate_data()
df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))
print(datetime.now()-t)

# 0:00:00.016012

t = datetime.now()
df = generate_data()
df["value"] = df.groupby(['category', 'name'])\
    .transform(lambda x: x.fillna(x.mean()))['value']
print(datetime.now()-t)

# 0:00:00.030022

Source: stackoverflow.com

Impute data by using groupby and transform

df['value'] = df.groupby(['category', 'name'])['value']\
    .transform(lambda x: x.fillna(x.mean()))

Source: stackoverflow.com

Similar codes

0 vote139 views1 answer
Operations in python
Python
2 votes141 views6 answers
K
Python
1 vote156 views1 answer
Module 'tensorflow_core.compat.v1.random' has no attribute 'set_seed'
Python
0 vote213 views1 answer
Django default none
Python Django
16 votes172 views3 answers
How to code music in python
Python
2 votes147 views1 answer
Python import json into pymongo
Python
0 vote181 views1 answer
Gcp functions save BQ
Python
0 vote159 views1 answer
Python get response from url
Python
-1 vote139 views2 answers
Write a python program to multiplies all the items in a list.
Python
0 vote145 views1 answer
How to use event of Button in python
Python