/Python/How to remove duplicate files from folder with python

How to remove duplicate files from folder with python

def remove_duplicates(dir):
    unique = []
    for filename in os.listdir(dir):
        if os.path.isfile(filename):
            filehash = md5.md5(file(filename).read()).hexdigest()
            if filehash not in unique: 
                unique.append(filehash)
            else: 
                os.remove(filename)

Source: stackoverflow.com

Similar codes

4 votes176 views4 answers
Change default python version
Python
1 vote105 views1 answer
Pandas multiple string contains
Python
0 vote92 views1 answer
How to visualize decision tree in python
Python
0 vote106 views1 answer
Pandas resamples stratified by columns values
Python
0 vote101 views1 answer
Pyspark import stringtype
Python
3 votes98 views1 answer
Pandas concat and reset index
Python
0 vote93 views1 answer
Userregisterform
Python
42 votes101 views6 answers
Train test split pandas
Python
0 vote107 views1 answer
Toy dataframe df simple
Python
0 vote95 views1 answer
Affinity propagation python
Python