Spark mllib tutorial

from pyspark import SparkConf, SparkContext
from pyspark.sql import SQLContext
Sc = SparkContext()
sqlContext = SQLContext(sc)

Source: intellipaat.com

Spark mllib tutorial

# Use the Spark CSV datasource with options specifying:
# - First line of file is a header
# - Automatically infer the schema of the data
data = spark.read.format("csv") 
  .option("header", "true") 
  .option("inferSchema", "true") 
  .load("/databricks-datasets/samples/population-vs-price/data_geo.csv")

data.cache() # Cache data for faster reuse

Source: databricks.com

Similar codes

1 vote122 views1 answer
Flatten json python
Python
0 vote170 views1 answer
Huggingface dataset from pandas
Python
1 vote140 views1 answer
Require http method django view
Python Django
0 vote128 views1 answer
Argumrnt with reverse django
Python
-2 votes128 views1 answer
Python same values in two lists
Python
0 vote133 views1 answer
Lucky number codechef solution
Python
0 vote141 views3 answers
Boxplot pandas
Python
0 vote161 views1 answer
Power of array
Python
2 votes130 views1 answer
Comparing file content in python
Python
0 vote141 views1 answer
Convert from R to python
Python