Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote218 views2 answers
Get lastest files from directory python
Python
0 vote193 views1 answer
.comments.all order django
Python
0 vote178 views1 answer
Gtk entry focus python
Python
1 vote194 views1 answer
Def dft(self, array): stack = Stack() visited = set() stack.append(self) while len(stack) > 0 and while len(visited) >= 0: current = stack.pop() array.append(current) visited.add(current) return array
Python
11 votes180 views2 answers
Add pip to path
Python
1 vote185 views1 answer
Get local python api image url
Python
0 vote178 views1 answer
Calculate the euler totient of a number python
Python
5 votes248 views6 answers
Youtube'
Python
0 vote215 views1 answer
Check permissions django template
Python Django
0 vote184 views1 answer
Jupyter nbconvert
Python