Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote155 views1 answer
Split string on '\n' python
Python
0 vote157 views1 answer
Flask files not updating
Python
0 vote160 views1 answer
Matplotlib despine
Python
0 vote168 views1 answer
Nsetools index list
Python
0 vote210 views1 answer
How to catch stop itteration in generator as None
Python
0 vote151 views1 answer
Python get screen size raspberry pi
Python
0 vote144 views1 answer
Postgresql backup using python
Python
0 vote158 views1 answer
Ubuntu 20.10 python 3.8
Python
108 votes164 views3 answers
Pandas dataframe column rename
Python
10 votes261 views1 answer
Is not none python
Python