Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

8 votes148 views3 answers
Sklearn roc curve
Python
0 vote187 views1 answer
Python pil to greyscale
Python
0 vote153 views1 answer
Python regex remove digits from string
Python
20 votes184 views2 answers
Create a list of a certain length python
Python
0 vote144 views1 answer
Get localapplication python
Python
2 votes157 views1 answer
Python b before string
Python
0 vote136 views1 answer
How to change pi hostname in python file
Python
0 vote154 views4 answers
How to convert array of arrays into single array with unique values in numpy
Python
0 vote146 views1 answer
Pip neat
Python
0 vote149 views1 answer
Python open dicom
Python