Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

0 vote153 views1 answer
Demploy django in vps
Python
0 vote147 views1 answer
Python generate sine wave pyaudio
Python
0 vote155 views1 answer
How to end an infinite loop in specific time python
Python
0 vote143 views1 answer
How to get parent model object based on child model filter in django
Python
0 vote147 views1 answer
Circular linked list in python
Python
8 votes148 views2 answers
If else elif python
Python
24 votes156 views6 answers
How to save a pickle file
Python
0 vote165 views1 answer
Dict column to be in multiple columns python
Python
0 vote177 views1 answer
Django jinja else if template tags
Python Django
0 vote107 views1 answer
Displaying cv2.imshow on specific window position
Python