Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

0 vote185 views1 answer
Response object has no code
Python
0 vote170 views1 answer
Python send sms
Python
0 vote193 views1 answer
How to check if given primary key exists in django model
Python
1 vote175 views1 answer
Open excel through python
Python
2 votes182 views1 answer
Python itertools.permutations use too much memory
Python
-1 vote221 views1 answer
Ga in python
Python
1 vote185 views1 answer
How to add a number to every element in a list python
Python
0 vote158 views1 answer
Python draw state diagrams
Python
15 votes188 views3 answers
Sum of 2 numbers in python
Python
0 vote173 views1 answer
Joint Plot Seaborn
Python