Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

2 votes191 views1 answer
Python sort two key
Python
2 votes414 views1 answer
Minimal flask application import
Python Flask
0 vote156 views1 answer
Template tag django
Python
21 votes161 views4 answers
Function in the input function python
Python
0 vote166 views1 answer
Convert excel cellname to index python
Python
0 vote137 views2 answers
Pydrive download file
Python
0 vote191 views1 answer
Pyad create user
Python
3 votes183 views1 answer
Local testing server Python
Python
11 votes162 views2 answers
Python datetime yesterday
Python
0 vote154 views1 answer
Find the Runner Up Score solution in python3
Python