VectorIndexer pyspark

from pyspark.ml import Pipeline
from pyspark.ml.regression import LinearRegression
from pyspark.ml.feature import VectorIndexer
from pyspark.ml.evaluation import RegressionEvaluator

# Automatically identify categorical features, and index them.
# We specify maxCategories so features with > 4 distinct values are treated as continuous.

featureIndexer = VectorIndexer(inputCol="features", \
                               outputCol="indexedFeatures",\
                               maxCategories=4).fit(transformed)

data = featureIndexer.transform(transformed)

Source: runawayhorse001.github.io

Similar codes

65 votes148 views5 answers
Python version check in cmd
Python
0 vote129 views2 answers
How to make a leaderboard in python
Python
5 votes133 views2 answers
TypeError: sequence item 0: expected str instance, int found
Python
0 vote127 views1 answer
Python assign variable to another variable
Python
0 vote137 views1 answer
How to make an entire dataframe show in jupyter
Python
0 vote135 views1 answer
ModuleNotFoundError: No module named 'nbformat'
Python
0 vote140 views1 answer
Python - regexp to find part of an email address
Python
0 vote143 views1 answer
Dict comprehensions
Python
0 vote141 views1 answer
Django rest DjangoModelPermissions include get
Python
0 vote147 views1 answer
Mypy Should never get here in normal mode, got NoneType: instead of TypeInfo
Python