Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

66 votes192 views6 answers
How to open csv file in python
Python
0 vote213 views1 answer
Pandas Timedelta to postgres
Python
0 vote222 views1 answer
Add image pptx python
Python
0 vote188 views1 answer
Python serial COM3
Python
2 votes188 views1 answer
Hide root window tkinter
Python
0 vote189 views1 answer
How to append variable python
Python
3 votes186 views1 answer
Multiply column of dataframe by number
Python
5 votes189 views3 answers
Django change password command line
Python
-1 vote180 views1 answer
Email validation using django
Python
1 vote231 views1 answer
Django createmany
Python Django