Spacy french stopwords

from spacy.lang.fr.stop_words import STOP_WORDS as fr_stop
from spacy.lang.en.stop_words import STOP_WORDS as en_stop

final_stopwords_list = list(fr_stop) + list(en_stop)
tfidf_vectorizer = TfidfVectorizer(max_df=0.8, max_features=200000, min_df=0.2, stop_words=final_stopwords_list, use_idf=True, tokenizer=tokenize_and_stem, ngram_range(1,3))

Source: stackoverflow.com

Spacy french stopwords

from nltk.corpus import stopwords

final_stopwords_list = stopwords.words('english') + stopwords.words('french')
tfidf_vectorizer = TfidfVectorizer(max_df=0.8, max_features=200000, min_df=0.2, stop_words=final_stopwords_list, use_idf=True, tokenizer=tokenize_and_stem, ngram_range(1,3))

Source: stackoverflow.com

Similar codes

2 votes147 views2 answers
Check all python versions ubuntu
Python
0 vote130 views1 answer
Read csv boto3
Python
5 votes136 views1 answer
Flask boiler plate
Python
0 vote135 views1 answer
How to swirtch the placement of the levels in pandas
Python
0 vote176 views1 answer
Add a new categorical column to an existing table python
Python
11 votes137 views6 answers
How to check the size of a file in python
Python
2 votes175 views2 answers
What is role of ALLOWED_HOSTs in Django
Python Django
0 vote143 views1 answer
Ipython and virtualenvs
Python
-1 vote138 views4 answers
How to say hello world in c++
Python
0 vote137 views1 answer
How to sharpen image in python using cv2
Python