Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote193 views1 answer
Tensorflow turn off gpu
Python
0 vote209 views1 answer
Column names reading csv file python
Python
1 vote194 views1 answer
Remove duplicate columns python dataframe
Python
0 vote215 views1 answer
How to get only one column from dataset in python
Python
0 vote248 views1 answer
Use colabs gpu locally
Python
0 vote190 views1 answer
Scrapy create project
Python
1 vote162 views1 answer
Find substring in string python
Python
2 votes190 views1 answer
What is a cube minus b cube
Python
1 vote207 views1 answer
Python delete elements from list / range
Python
0 vote176 views1 answer
How to check if a list is a subset of another list
Python