VectorIndexer pyspark

from pyspark.ml import Pipeline
from pyspark.ml.regression import LinearRegression
from pyspark.ml.feature import VectorIndexer
from pyspark.ml.evaluation import RegressionEvaluator

# Automatically identify categorical features, and index them.
# We specify maxCategories so features with > 4 distinct values are treated as continuous.

featureIndexer = VectorIndexer(inputCol="features", \
                               outputCol="indexedFeatures",\
                               maxCategories=4).fit(transformed)

data = featureIndexer.transform(transformed)

Source: runawayhorse001.github.io

Similar codes

13 votes125 views4 answers
Pandas list to df
Python
1 vote92 views1 answer
How to print the max occurring in dictionary python
Python
2 votes167 views1 answer
Hyperlinks in jupyter notebook
Python
0 vote143 views1 answer
Find position of key in dictionary python
Python
30 votes143 views3 answers
Python day from datetime
Python
2 votes119 views1 answer
Extract text regex python
Python
8 votes128 views3 answers
How to delete nan values in python
Python
1 vote137 views1 answer
Two elements at a time in list comprehension
Python
0 vote127 views1 answer
Remove emoji
Python
0 vote161 views1 answer
Get processor model in python
Python