Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote144 views1 answer
ModuleNotFoundError: No module named 'html5lib'
Python
4 votes133 views1 answer
Pandas add dataframe to the bottom of another
Python
0 vote183 views2 answers
Bst in python
Python
1 vote133 views2 answers
How to add watermark in mp4 video using python
Python
1 vote139 views1 answer
Get number of key in dictionary python
Python
6 votes142 views3 answers
Np random seed
Python
0 vote174 views1 answer
How to plot a linear equation in matplotlib
Python
10 votes142 views5 answers
Check gpu in tensorflow
Python
0 vote141 views1 answer
Query a PSQL Database From Python
Python
58 votes130 views2 answers
Find an index of an item in a list python
Python