Pyspark read from redshift

from pyspark.sql import SQLContext

sc = # existing SparkContext
sql_context = SQLContext(sc)

# Read data from a table
df = sql_context.read \
    .format("com.databricks.spark.redshift") \
    .option("url", "jdbc:redshift://redshifthost:5439/database?user=username&password=pass") \
    .option("dbtable", "my_table") \
    .option("tempdir", "s3n://path/for/temp/data") \
    .load()

Similar codes

0 vote241 views1 answer
Using claudinary in django
Python Django
1 vote169 views1 answer
String to tuple python
Python
0 vote163 views1 answer
Returns the first row as a Row
Python
0 vote191 views1 answer
Python interface kenee
Python
1 vote160 views1 answer
From time import sleep, time
Python
0 vote166 views1 answer
Float infinity python
Python
0 vote182 views1 answer
Box Plot, Python
Python
0 vote161 views2 answers
Change markersize in legend matplotlib
Python
0 vote215 views1 answer
Python remove file with pattern
Python
5 votes179 views5 answers
Pandas shape
Python