Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

6 votes173 views3 answers
Np random seed
Python
0 vote177 views1 answer
Python identify array
Python
0 vote163 views1 answer
Wordcount pyspark
Python
9 votes259 views5 answers
Get dummies pandas
Python
0 vote172 views1 answer
Python list all but first
Python
0 vote210 views1 answer
Apa itu duck typing python
Python
7 votes179 views1 answer
Replace cell pandas
Python
5 votes170 views2 answers
Python fetch url
Python
0 vote243 views1 answer
Pandas add days to date
Python
8 votes203 views4 answers
Print pandas version
Python