Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote139 views1 answer
PIL Make Circle
Python
0 vote136 views1 answer
Create a date value array in python
Python
0 vote172 views1 answer
Streamlit bold
Python
0 vote146 views1 answer
Quicksort in Python site:stackoverflow.com
Python
0 vote149 views1 answer
\n vs \r python
Python
22 votes135 views6 answers
Python strings
Python
-1 vote139 views1 answer
Unocode error pytonn
Python
0 vote130 views1 answer
Unique mark boolean django model field
Python
1 vote147 views1 answer
Http client post python
Python
0 vote148 views1 answer
A GDAL API version must be specified. Provide a path to gdal-config using a GDAL_CONFIG environment variable or use a GDAL_VERSION environment variable.
Python