Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

1 vote160 views1 answer
Can't convert np.ndarray of type numpy.object_.
Python
2 votes120 views6 answers
Variable python
Python
0 vote132 views1 answer
Get the time of 1 minute later in python
Python
1 vote126 views1 answer
Print every element in list python outside string
Python
0 vote130 views1 answer
How to get a list of all variables in memory python
Python
82 votes135 views6 answers
How to create a for loop in python
Python
5 votes146 views2 answers
Python windows notification
Python
0 vote134 views1 answer
Minimumm sort tryed python
Python
0 vote168 views1 answer
Django MESSAGE_TAGS
Python Django
1 vote135 views2 answers
Create requirements.txt conda
Python