/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote167 views1 answer
Django user refistration
Python
0 vote168 views1 answer
Re date python
Python
12 votes226 views5 answers
Django-cors-headers
Python Django
0 vote127 views1 answer
Run a python script with python and catch command line output
Python
3 votes180 views2 answers
Django change user password
Python
1 vote153 views2 answers
Numpy random for string
Python
2 votes180 views2 answers
Pandas shift columns down until value
Python
0 vote307 views1 answer
Or operator in django queryset
Python Django
0 vote425 views1 answer
Range all columns of df such that the minimum value in each column is 0 and max is 1. in pandas
Python
19 votes192 views2 answers
Learn python 3
Python