Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote200 views1 answer
Boolean indexing datetime object | converting string to datetime object
Python
65 votes148 views4 answers
How to sum all the numbers in a list in python
Python
0 vote169 views1 answer
If condition in djangio template
Python
0 vote139 views1 answer
Keras load model with custom objects
Python
1 vote144 views1 answer
Python dictionary dot product
Python
3 votes131 views4 answers
List in pythom
Python
0 vote165 views1 answer
Input function in django
Python Django
2 votes144 views1 answer
How to append element python
Python
0 vote156 views2 answers
Import static
Python
0 vote143 views1 answer
Pandas dataframe get number of occurrence in column
Python