Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

0 vote119 views1 answer
Django serializer get image list
Python
0 vote140 views1 answer
Fibonacci series list comphrehension in python
Python
0 vote131 views1 answer
Mongoengine ObjectIdField
Python
0 vote129 views1 answer
Line plot python only years datetime index
Python
3 votes134 views1 answer
Accessing items of tuple in python
Python
5 votes125 views2 answers
Who created python
Python
0 vote134 views1 answer
Python type hint array of objects
Python
0 vote124 views1 answer
Find maximum element in stack
Python
5 votes130 views1 answer
How to make a sigmoid function in python
Python
11 votes140 views2 answers
Adding to python path
Python