/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

11 votes330 views2 answers
Regression python
Python
0 vote184 views2 answers
Append two 1d arrays python
Python
0 vote238 views2 answers
Django swagger
Python Django
0 vote169 views1 answer
How to print keys and values of dictionary together in python?
Python
0 vote186 views1 answer
Pandas column string first n characters
Python
8 votes182 views3 answers
Load model keras
Python
10 votes170 views5 answers
Pandas number of columns
Python
15 votes267 views4 answers
Q django
Python Django
0 vote184 views2 answers
Style django forms with crisp
Python
0 vote178 views1 answer
Pygame.K_KP_ENTER
Python