Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

1 vote137 views2 answers
Reverse a list in python using recursion
Python
12 votes124 views3 answers
Python delete all files in directory
Python
0 vote125 views1 answer
Accumulator programming python
Python
1 vote145 views1 answer
Python delete elements from list / range
Python
0 vote135 views1 answer
How to skip the first line of a csv file
Python
0 vote146 views1 answer
Tar: Exiting with failure status due to previous errors
Python
0 vote328 views1 answer
Np array blurring
Python
1 vote127 views1 answer
Plt imshow python
Python
7 votes122 views1 answer
// meaning in python
Python
0 vote128 views1 answer
String acharacters count in python without using len
Python