Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote126 views1 answer
Python reading into a text file and diplaying items in a user friendly manner
Python
2 votes111 views1 answer
How to make a letter animation in python
Python
0 vote151 views1 answer
Setting up a django prostgress project
Python Django
54 votes166 views6 answers
Conda create environment python 3.6
Python
10 votes137 views1 answer
Python turtle
Python
4 votes126 views1 answer
What is cleaned data in django
Python
0 vote110 views1 answer
Enumerate in django templte
Python
1 vote116 views1 answer
Remove single and double quotes from string python
Python
18 votes101 views4 answers
Python remove duplicate numbers
Python
0 vote110 views1 answer
Python flask models user
Python