Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

1 vote226 views1 answer
Passing Functions Around python
Python
80 votes149 views12 answers
Python3 if else
Python
0 vote197 views1 answer
Python drop the first word
Python
0 vote201 views1 answer
How to solve trig equations with jupyter notebook
Python
0 vote183 views1 answer
Last executed query in flask api
Python
0 vote185 views1 answer
Python prime number sum
Python
2 votes189 views1 answer
8 ball responses list python
Python
0 vote193 views1 answer
Np.random.randint to generate -1 +1
Python
0 vote203 views1 answer
Python convert number to base
Python
0 vote256 views1 answer
Sql o que é
Python