/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

0 vote179 views1 answer
For loop to create a set of counters in python
Python
0 vote180 views1 answer
Count upper case characters in a string
Python
0 vote159 views1 answer
Xpath parsing in python
Python
5 votes243 views3 answers
How to run flask in port 80
Python Flask
0 vote159 views1 answer
No module named 'django_hitcounter'
Python
1 vote149 views2 answers
Found features with object datatype
Python
1 vote146 views1 answer
Pip upgrade wheel
Python
0 vote196 views1 answer
How to fix invalid salt in python flask
Python Flask
1 vote225 views1 answer
Django templateview
Python Django
1 vote150 views1 answer
Evaluate how much a python program memory
Python