Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

76 votes139 views6 answers
For loop in python
Python
0 vote123 views1 answer
Remove exponent pandas plot
Python
12 votes112 views3 answers
Python efficiently find duplicates in list
Python
0 vote138 views1 answer
Minimum of two columns in pandas
Python
0 vote111 views1 answer
Pandas read to a csv file
Python
0 vote119 views1 answer
Onetomany field
Python
0 vote125 views1 answer
System to extract data from csv file in python
Python
0 vote130 views1 answer
Login views django template passing
Python
2 votes120 views2 answers
Check if boolean is true python
Python
107 votes119 views6 answers
Python split
Python