Pandas parallelize for loop

import multiprocessing as mp
pool = mp.Pool(processes=mp.cpu_count())

def func( arg ):
    idx,row = arg
	# Edit df
    return row

new_rows = pool.map( func, [(idx,row) for idx,row in data_all.iterrows()])
data_all_new = pd.concat( new_rows )

Source: stackoverflow.com

Similar codes

10 votes141 views4 answers
Pandas
Python
11 votes153 views4 answers
Add conda env to jupyter
Python
0 vote158 views1 answer
Python - subtracting dictionary values
Python
3 votes215 views2 answers
Python iterate over string
Python
0 vote146 views1 answer
Round list of floats python
Python
1 vote137 views1 answer
Python remove non empty read only directory
Python
0 vote157 views1 answer
How to delete all item in treeview tkinter
Python
0 vote157 views1 answer
One liner if else replacement in python
Python
1 vote148 views1 answer
Failed to execute script
Python
0 vote145 views1 answer
Get text content dynamo civil 3d
Python