VectorIndexer pyspark

from pyspark.ml import Pipeline
from pyspark.ml.regression import LinearRegression
from pyspark.ml.feature import VectorIndexer
from pyspark.ml.evaluation import RegressionEvaluator

# Automatically identify categorical features, and index them.
# We specify maxCategories so features with > 4 distinct values are treated as continuous.

featureIndexer = VectorIndexer(inputCol="features", \
                               outputCol="indexedFeatures",\
                               maxCategories=4).fit(transformed)

data = featureIndexer.transform(transformed)

Source: runawayhorse001.github.io

Similar codes

1 vote160 views1 answer
Mish activation function tensorflow
Python
1 vote197 views1 answer
File searching in python
Python
0 vote201 views1 answer
Mute button tkinter
Python
1 vote218 views1 answer
Auto-created primary key used when not defining a primary key type, by default 'django.db.models.AutoField'.
Python Django
0 vote162 views1 answer
Read api from django
Python
0 vote175 views1 answer
Pahtlib join path
Python
1 vote191 views1 answer
How to get all messages from a telegram group with telethon
Python
0 vote161 views1 answer
Port python script to jupyter notebook
Python
0 vote185 views2 answers
Knapsack problem using greedy method in python
Python
5 votes247 views6 answers
Youtube'
Python