Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote154 views1 answer
Matplotlib: use colormaps for line plot colors
Python
0 vote154 views1 answer
Scipy version check
Python
0 vote177 views1 answer
Javascript parse url with values and anchors
Python
0 vote158 views1 answer
How to add previous and next in tkinter in python
Python
0 vote168 views1 answer
Split() method, sep=i, n=veces aplicado
Python
0 vote158 views1 answer
Python list object ids
Python
0 vote170 views1 answer
Connect mysql sql alchemy
Python
14 votes160 views2 answers
How to change the background of heading in tkinter
Python
0 vote149 views1 answer
Remove tab space from string in python
Python
2 votes153 views1 answer
Django setup allowed hosts
Python