Pandas read_csv random rows

import pandas as pd
import numpy as np

filename = 'hugedatafile.csv'
nlinesfile = 10000000
nlinesrandomsample = 10000
lines2skip = np.random.choice(np.arange(1,nlinesfile+1), (nlinesfile-nlinesrandomsample), replace=False)
df = pd.read_csv(filename, skiprows=lines2skip)

Source: stackoverflow.com

Similar codes

0 vote168 views1 answer
Python how to initialize wikipediaapi
Python
0 vote170 views1 answer
How to set propee timeline in python
Python
0 vote180 views2 answers
Torch print full tensor
Python
0 vote169 views1 answer
Get maximum values in a column by a subgroup of a dataframe pandas
Python
1 vote295 views1 answer
Not null constraint failed django
Python
0 vote166 views1 answer
Python numpy find local minima
Python
0 vote174 views1 answer
Openpyxl iter_rows skip first
Python
0 vote174 views1 answer
For pyton
Python
0 vote177 views1 answer
Run django localhost server
Python
1 vote163 views1 answer
Hashlib sha 256
Python