Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

0 vote159 views1 answer
Python remove consecutive spaces
Python
0 vote183 views1 answer
Get a colomn of csv in pandas
Python
0 vote158 views1 answer
Check all true python
Python
15 votes189 views6 answers
How to get confusion matrix in python
Python
21 votes240 views6 answers
Python avg
Python
0 vote157 views6 answers
Convert from python code to c++ code
Python
0 vote157 views1 answer
Python pandas in list
Python
2 votes201 views1 answer
Get stats from array
Python
133 votes162 views6 answers
How to use input in python
Python
0 vote138 views1 answer
How to put song in pygame
Python