Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

185 votes264 views6 answers
How to update pip in python
Python
1 vote161 views2 answers
How to view all attributes and methods of an object python
Python
30 votes124 views6 answers
How to create a superuser in django
Python
5 votes121 views3 answers
How to print hello in python
Python
1 vote125 views1 answer
Os remove entire folder python
Python
0 vote135 views1 answer
Python measure volum from audio file
Python
0 vote118 views1 answer
Python close a socket
Python
1 vote160 views1 answer
Initialize array of natural numbers python
Python
0 vote118 views1 answer
Solidity compiler for python
Python
0 vote128 views2 answers
How to update sklearn
Python