Duplicate finder python modules

def findDup(parentFolder):
    # Dups in format {hash:[names]}
    dups = {}
    for dirName, subdirs, fileList in os.walk(parentFolder):
        print('Scanning %s...' % dirName)
        for filename in fileList:
            # Get the path to the file
            path = os.path.join(dirName, filename)
            # Calculate hash
            file_hash = hashfile(path)
            # Add or append the file path
            if file_hash in dups:
                dups[file_hash].append(path)
            else:
                dups[file_hash] = [path]
    return dups

Source: pythoncentral.io

Similar codes

0 vote106 views1 answer
Get the values of your aws tags from ec2 instance
Python
1 vote140 views2 answers
Run flask in background
Python Flask
0 vote103 views5 answers
Dynamically limiting queryset of related field
Python
0 vote134 views1 answer
Docker-compose.yml for flask celery rabbitmq
Python
6 votes105 views2 answers
How to sort a list randomly in python
Python
0 vote97 views1 answer
Pygame.set_volume(2.0) max volume
Python
7 votes102 views1 answer
Python how to run terminal command
Python
5 votes100 views1 answer
Append item to array python
Python
0 vote100 views1 answer
Cv2 warpaffine rotate
Python
1 vote96 views1 answer
Python named group regex example
Python