Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

20 votes141 views6 answers
Random Number Generator
Python
0 vote145 views1 answer
Python remove \xa0
Python
-1 vote130 views1 answer
Calculate quantiles python
Python
13 votes153 views4 answers
How to count number of unique values in a column python
Python
0 vote138 views1 answer
Lenet 5 keras
Python
0 vote129 views1 answer
Assert with message python
Python
0 vote160 views1 answer
How to make input box if else statement in tkinter
Python
0 vote151 views1 answer
Pycharm Error: Please select a valid Python interpreter
Python
0 vote120 views1 answer
Whitelist the ip address django
Python
0 vote175 views1 answer
How to numbered jupyter notebook
Python