Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

15 votes172 views6 answers
Python filter
Python
12 votes142 views6 answers
Remove empty strings from list python
Python
0 vote78 views1 answer
Django trim string whitespace
Python
13 votes209 views5 answers
Python run curl
Python
0 vote122 views1 answer
Python del var if exists
Python
0 vote118 views1 answer
Reactstrap example
Python
0 vote122 views1 answer
Django admin no such table user
Python
1 vote118 views1 answer
Sorting by second element
Python
0 vote115 views1 answer
Pytorch forecasting
Python
0 vote123 views2 answers
How to read excel with multiple pages on pandas
Python