/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

0 vote162 views2 answers
Beautifulsoup get parent element
Python
0 vote187 views1 answer
How to train Longistic regression with given threshold
Python
1 vote164 views1 answer
Import bokeh
Python
0 vote159 views1 answer
Python import worldcloud
Python
0 vote161 views1 answer
Push notification using python
Python
0 vote184 views1 answer
Series object has no attribute columns
Python
0 vote168 views1 answer
Convert tuple to array python
Python
6 votes167 views2 answers
Iterable meaning
Python
0 vote173 views1 answer
Pandas loop over chunk of rows
Python
0 vote187 views1 answer
Python boto3 ypload_file to s3
Python