Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote135 views1 answer
Customise the django rest api view
Python
0 vote134 views1 answer
Split an array into subarrays python
Python
8 votes143 views3 answers
Python execute function from string
Python
0 vote161 views1 answer
Python import file from same level
Python
0 vote139 views1 answer
Remove initial space python
Python
10 votes144 views2 answers
Python re.search()
Python
0 vote133 views1 answer
List get both index and value.
Python
0 vote164 views1 answer
Print python setencode
Python
5 votes136 views2 answers
Matplotlib python background color
Python
2 votes115 views2 answers
Python threading return value
Python