/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

1 vote180 views2 answers
What is fourier transform in python
Python
5 votes171 views2 answers
Python plot two lines on same graph
Python
4 votes228 views2 answers
Flask get variable from url
Python Flask
0 vote234 views2 answers
Bst in python
Python
0 vote134 views1 answer
Pandas parallelize for loop
Python
1 vote184 views1 answer
Python change name of the imported function
Python
11 votes181 views4 answers
Multiple line input python
Python
0 vote178 views1 answer
Comment transformer un chaine de caractere en liste python
Python
-1 vote209 views1 answer
Python one sample t-test
Python
0 vote167 views1 answer
Plot line2d on axis
Python