Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

1 vote282 views1 answer
Sum values in django models
Python
0 vote157 views1 answer
Paho mqtt reconnect in python
Python
1 vote158 views1 answer
Python unicode is not defined
Python
8 votes152 views6 answers
Fizzbuzz python
Python
1 vote162 views1 answer
Heroku requirements.txt python
Python
2 votes187 views1 answer
Postgres django settings
Python Django
9 votes143 views2 answers
Fill missing values in column pandas with mean
Python
0 vote140 views1 answer
Gui radio button python
Python
2 votes166 views2 answers
Convert list to generator python
Python
22 votes191 views6 answers
Import turtle python
Python