Spacy french stopwords

from spacy.lang.fr.stop_words import STOP_WORDS as fr_stop
from spacy.lang.en.stop_words import STOP_WORDS as en_stop

final_stopwords_list = list(fr_stop) + list(en_stop)
tfidf_vectorizer = TfidfVectorizer(max_df=0.8, max_features=200000, min_df=0.2, stop_words=final_stopwords_list, use_idf=True, tokenizer=tokenize_and_stem, ngram_range(1,3))

Source: stackoverflow.com

Spacy french stopwords

from nltk.corpus import stopwords

final_stopwords_list = stopwords.words('english') + stopwords.words('french')
tfidf_vectorizer = TfidfVectorizer(max_df=0.8, max_features=200000, min_df=0.2, stop_words=final_stopwords_list, use_idf=True, tokenizer=tokenize_and_stem, ngram_range(1,3))

Source: stackoverflow.com

Similar codes

4 votes99 views1 answer
Np.random.uniform
Python
3 votes130 views2 answers
How to make a grid in python
Python
0 vote95 views1 answer
How to remove text in pygame
Python
0 vote85 views1 answer
Check for double character in a string python
Python
4 votes107 views3 answers
How to create one list from 2d list python
Python
0 vote101 views1 answer
6.2.2.4 packet tracer
Python
2 votes121 views2 answers
Python split string capital letters
Python
8 votes100 views3 answers
Python datetime to unix timestamp
Python
1 vote63 views1 answer
Break outside loop python
Python
5 votes100 views2 answers
Turn df to dict
Python