/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

-1 vote148 views1 answer
How to load pretrained model in pytorch
Python
0 vote145 views2 answers
Remove empty lines from file python
Python
1 vote148 views1 answer
How to leave some parameters in python and let the value be anything
Python
9 votes157 views4 answers
Python for file in dir
Python
0 vote162 views1 answer
Fetch row where column is missing pandas
Python
1 vote181 views1 answer
How to become python developer
Python
8 votes150 views2 answers
Print list in one line python
Python
0 vote174 views1 answer
Update all packages using pip on Windows
Python
5 votes225 views3 answers
ImportError: No module named flask
Python Flask
-1 vote165 views2 answers
Python dict remove duplicates where name are not the same
Python