VectorIndexer pyspark

from pyspark.ml import Pipeline
from pyspark.ml.regression import LinearRegression
from pyspark.ml.feature import VectorIndexer
from pyspark.ml.evaluation import RegressionEvaluator

# Automatically identify categorical features, and index them.
# We specify maxCategories so features with > 4 distinct values are treated as continuous.

featureIndexer = VectorIndexer(inputCol="features", \
                               outputCol="indexedFeatures",\
                               maxCategories=4).fit(transformed)

data = featureIndexer.transform(transformed)

Source: runawayhorse001.github.io

Similar codes

0 vote220 views1 answer
Take substring of every element in dataframe
Python
0 vote165 views1 answer
How to console log in django heroku
Python
0 vote239 views1 answer
Split and only grab first part of string
Python
4 votes163 views2 answers
Nested in python
Python
29 votes380 views5 answers
Static dirs django
Python Django
1 vote163 views1 answer
Fatal error detected failed to execute script
Python
1 vote229 views1 answer
Python multiple conditions in dataframe column values
Python
2 votes169 views4 answers
Eval function
Python
1 vote167 views1 answer
Check value vowel user input python
Python
4 votes171 views4 answers
Filter django or
Python