Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

1 vote178 views2 answers
Remove first element from list
Python
2 votes168 views2 answers
What is role of ALLOWED_HOSTs in Django
Python
0 vote148 views1 answer
R stagazer html knit
Python
2 votes167 views1 answer
Native bold text
Python
3 votes178 views1 answer
List in python 3
Python
80 votes132 views12 answers
Python3 if else
Python
0 vote184 views1 answer
Run exe for python and wait until finish
Python
0 vote184 views1 answer
RuntimeError: Please use tf.experimental.tensorrt.Converter in TF 2.0. site:stackoverflow.com
Python
11 votes205 views4 answers
How to make a qr code generator in python
Python
7 votes156 views2 answers
How to create a variablein python
Python