Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

-1 vote104 views4 answers
Hex to string python
Python
0 vote104 views1 answer
Python discord server
Python
0 vote111 views1 answer
If a specific column name is present drop tyhe column
Python
32 votes95 views3 answers
Python move files
Python
1 vote91 views1 answer
How to make a crosshair in python
Python
20 votes105 views1 answer
Python time a funciton
Python
17 votes134 views4 answers
Bubble sort python
Python
2 votes142 views1 answer
Django static media
Python Django
0 vote98 views1 answer
Response object has no code
Python
0 vote84 views1 answer
Bfs in python 3
Python