Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

0 vote114 views2 answers
How to get current page url in django template
Python
1 vote126 views1 answer
Qspinbox disable wheel python
Python
9 votes127 views2 answers
Python library to make qr codes
Python
0 vote128 views1 answer
Python select from list by boolean list
Python
125 votes130 views6 answers
How to take input from user in python
Python
1 vote125 views1 answer
How do i print when my bot is ready in discord.py
Python
1 vote124 views1 answer
Pandas column rank
Python
2 votes119 views1 answer
How to downgrade python to 3.7 4 anaconda
Python
0 vote130 views1 answer
Reorder list python
Python
2 votes125 views3 answers
Python relative path
Python