Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

1 vote140 views1 answer
Get attribute in selenium python
Python
1 vote161 views1 answer
Acess nvidia from docker compose
Python
11 votes153 views4 answers
Length of string python
Python
-1 vote152 views1 answer
Class views django slug
Python
22 votes152 views2 answers
Export pandas dataframe as excel
Python
0 vote144 views1 answer
S3 pre signed url python
Python
0 vote158 views1 answer
Make y axis start at 0 python
Python
1 vote152 views1 answer
Tf.contrib.layers.xavier_initializer() tf2
Python
83 votes164 views6 answers
Activate venv windows
Python
0 vote173 views1 answer
How to run django server outside world
Python