Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

1 vote132 views1 answer
Django making a custom 403 page
Python
12 votes129 views3 answers
How to get the url of the current page in selenium python
Python
-3 votes135 views2 answers
Multiplication table python
Python
0 vote122 views1 answer
Insert video in tkinter
Python
0 vote129 views2 answers
Pandas convert entries in a column after groupby in list
Python
0 vote125 views1 answer
Chat bot in python
Python
0 vote133 views1 answer
Reportlab line thickness
Python
1 vote121 views1 answer
Python template generics
Python
5 votes130 views3 answers
How to print multiple lines in one line python
Python
1 vote169 views2 answers
Pandas group by month
Python