Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote185 views1 answer
Sqlite python select with parameters
Python
4 votes215 views1 answer
Python float to fraction
Python
0 vote178 views1 answer
Check if any entries arte none
Python
0 vote179 views1 answer
Python get host.docker.internal ip site:stackoverflow.com
Python
4 votes172 views1 answer
Pandas date missing from datetime
Python
0 vote195 views1 answer
Python get time executed by function
Python
3 votes164 views1 answer
Stripping /n in a readlines for a pytgon file
Python
0 vote183 views1 answer
Python tokenize sentence italian spacy
Python
0 vote177 views1 answer
Multiprocessing pool pass additional arguments
Python
11 votes209 views2 answers
How to print a list without brackets and commas python
Python