/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote184 views1 answer
Gensim wordvector vocabulary list
Python
0 vote237 views1 answer
TypeError: Direct assignment to the forward side of a many-to-many set is prohibited. Use .set() instead
Python
49 votes252 views10 answers
Reddit
Python
20 votes182 views6 answers
List input python
Python
0 vote204 views1 answer
How to return number in binary python
Python
2 votes202 views1 answer
Resampling data python
Python
0 vote190 views1 answer
Def areEquallyStrong(yourLeft, yourRight, friendsLeft, friendsRight):python execution
Python
0 vote237 views1 answer
Python Remove all occurrences of a character from a string
Python
0 vote209 views1 answer
"detail": "Method \"POST\" not allowed." django
Python
0 vote268 views1 answer
Hpw to create related model in django rest framework logic
Python Django