/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

1 vote162 views1 answer
Django model query join
Python Django
0 vote133 views1 answer
New print on the same line substitution python 3
Python
-1 vote124 views2 answers
Do not show figure matplotlib
Python
1 vote114 views1 answer
Django gunicorn static file not found
Python
0 vote163 views1 answer
Strptime() many format
Python
0 vote125 views2 answers
Python plus
Python
0 vote83 views1 answer
Keras callbacks
Python
34 votes136 views6 answers
Simple flask app
Python
0 vote125 views1 answer
Python regex remove digits from string
Python
1 vote157 views1 answer
All subarrays of an array python
Python