Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

0 vote101 views1 answer
Rstudi matplotlib crash qt
Python
6 votes109 views1 answer
Pandas select row with substring
Python
0 vote185 views1 answer
Relative path django
Python Django
3 votes103 views2 answers
Sort tuple by first element python
Python
1 vote111 views2 answers
How to find 1 st digit in python
Python
0 vote102 views1 answer
Nth term of gp in python when 2,3 terms given
Python
0 vote59 views1 answer
Part of list into dataframe
Python
-1 vote99 views1 answer
Get the largest of 2 strings python
Python
2 votes110 views1 answer
Pygame how to draw a rectangle
Python
4 votes168 views1 answer
Create or update django models
Python Django