Extract bigrams python

from nltk import word_tokenize 
from nltk.util import ngrams


text = ['cant railway station', 'citadel hotel', 'police stn']
for line in text:
    token = nltk.word_tokenize(line)
    bigram = list(ngrams(token, 2))

    # the '2' represents bigram...you can change it to get ngrams with different size

Source: stackoverflow.com

Similar codes

0 vote180 views1 answer
Pyserial read
Python
0 vote171 views1 answer
How to use python to download files from the interent
Python
0 vote180 views1 answer
Python assert is not null
Python
1 vote124 views1 answer
Numpy get count of list
Python
24 votes188 views1 answer
Print type(x) in python
Python
3 votes172 views1 answer
Django admin prefetch_related
Python
0 vote210 views1 answer
Color module python
Python
-1 vote180 views2 answers
Sequence in python
Python
1 vote198 views1 answer
Classification cross validation
Python
1 vote181 views1 answer
How does urllib.parse.urlsplit work in python
Python