Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

94 votes108 views5 answers
How to rename columns using panda object
Python
0 vote164 views1 answer
Python conda how to see channels command
Python
8 votes113 views2 answers
Python iterate backwards through list
Python
2 votes114 views6 answers
How to merge more than 2 dataframes in python
Python
0 vote122 views1 answer
Add new dimension
Python
1 vote73 views1 answer
How to display speechmarks in python string
Python
0 vote107 views2 answers
Scrapy capture: Error downloading
Python
70 votes147 views6 answers
Python alphabet
Python
0 vote136 views1 answer
Recorrer diccionario python
Python
0 vote120 views1 answer
Defaultdict initialize keys
Python