Extract bigrams python

from nltk import word_tokenize 
from nltk.util import ngrams


text = ['cant railway station', 'citadel hotel', 'police stn']
for line in text:
    token = nltk.word_tokenize(line)
    bigram = list(ngrams(token, 2))

    # the '2' represents bigram...you can change it to get ngrams with different size

Source: stackoverflow.com

Similar codes

0 vote109 views1 answer
Python extend vs append
Python
0 vote93 views1 answer
Python toupls
Python
0 vote95 views1 answer
List range
Python
2 votes94 views1 answer
Python how to get the folder name of a file
Python
1 vote101 views1 answer
Python psycopg2 utf8
Python
1 vote103 views2 answers
How to change font in tkinter
Python
2 votes104 views1 answer
Get all files within multiple directories python
Python
0 vote98 views1 answer
Join a list of items with different types as string in Python
Python
103 votes106 views4 answers
Separate a string in python
Python
0 vote98 views1 answer
Theme_use() tkinter theme usage
Python