/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

9 votes115 views1 answer
Install matplotlib conda
Python
-1 vote106 views1 answer
Pyaudio mic stream
Python
2 votes94 views1 answer
Father's day 2020
Python
26 votes100 views3 answers
Discord py bot status
Python
0 vote102 views1 answer
Pprint dic without sorting
Python
2 votes95 views2 answers
How to exit the program in pygame
Python
1 vote112 views1 answer
F string python not working in linux
Python
36 votes99 views4 answers
Print colored text to console python
Python
0 vote100 views2 answers
Give utton a number python
Python
0 vote91 views2 answers
Program to replace lower-case characters with upper-case and vice versa in python
Python