Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote110 views1 answer
Spotify meist gespielte lieder sehen
Python
3 votes133 views1 answer
Django admin prefetch_related
Python Django
2 votes108 views1 answer
Creating data frame in python with for loop
Python
1 vote106 views2 answers
Location of python in cmd
Python
9 votes138 views2 answers
Django app
Python Django
0 vote137 views5 answers
Space weather dashboard build your own custom dashboard to analyze and predict weather
Python
0 vote101 views1 answer
Python default function value
Python
10 votes104 views5 answers
List of dict to dataframe
Python
0 vote101 views1 answer
Pythongalaxy.com
Python
15 votes103 views2 answers
Python from timestamp to string
Python