Pyspark read from redshift

from pyspark.sql import SQLContext

sc = # existing SparkContext
sql_context = SQLContext(sc)

# Read data from a table
df = sql_context.read \
    .format("com.databricks.spark.redshift") \
    .option("url", "jdbc:redshift://redshifthost:5439/database?user=username&password=pass") \
    .option("dbtable", "my_table") \
    .option("tempdir", "s3n://path/for/temp/data") \
    .load()

Similar codes

0 vote153 views1 answer
Export some columns to csv pandas
Python
1 vote175 views2 answers
Django make new application folder
Python Django
0 vote146 views2 answers
Assign multiple columns pandas
Python
0 vote152 views1 answer
Store content to file python
Python
1 vote128 views1 answer
Python - How To Ways to Remove xa0 From a String
Python
1 vote133 views1 answer
How to clear a pickle file
Python
12 votes158 views2 answers
Print json python
Python
6 votes144 views2 answers
Python square a number
Python
3 votes141 views1 answer
Streamlit ssl error
Python
1 vote165 views1 answer
Pygame examples
Python