/Python/Txt file duplicate line remover python

Txt file duplicate line remover python

lines_seen = set() # holds lines already seen

with open("file.txt", "r+") as f:
    d = f.readlines()
    f.seek(0)
    for i in d:
        if i not in lines_seen:
            f.write(i)
            lines_seen.add(i)
    f.truncate()

Source: stackoverflow.com

Similar codes

6 votes165 views3 answers
Download image from url python 3
Python
-1 vote140 views1 answer
AI code in Pythin
Python
0 vote130 views2 answers
Error: Could not locate a Flask application. You did not provide the "FLASK_APP" environment variable, and a "wsgi.py" or "app.py" module was not found in the current directory.
Python
0 vote147 views1 answer
Python sh command
Python
2 votes131 views2 answers
How to get only first record in django
Python
6 votes110 views2 answers
How to install python2 in ubuntu
Python
0 vote142 views1 answer
How to create empty series in pandas
Python
-1 vote304 views4 answers
Flask documentation
Python Flask
0 vote141 views1 answer
Creating a frequency table | generating a frequency table
Python
0 vote153 views1 answer
How to loop through pages of pdf using python
Python