Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

4 votes147 views2 answers
Pyautogui.click
Python
0 vote176 views2 answers
Deleting files which start with a name
Python
0 vote134 views1 answer
HTTP Error 403: Forbidden django account signup email
Python Django
16 votes174 views3 answers
Python clear file before writing
Python
0 vote199 views1 answer
Find a string hackereank
Python
5 votes147 views6 answers
Unable to create process using
Python
18 votes162 views3 answers
How to use histogram in python
Python
8 votes162 views5 answers
No module psycopg2
Python
7 votes162 views1 answer
Discord.py ban
Python
12 votes154 views3 answers
How to install dependencies python
Python