/Python/Connect spark to postgres; connect spark to database

Connect spark to postgres; connect spark to database

spark = SparkSession.builder.config(conf=spark_conf).getOrCreate()

#make sure the necessary jar files are loaded
#@ opt/spark/jars folder

df = spark.read \
    .format("jdbc") \
    .option("url", "jdbc:postgresql://<host>:<port>/<db_name>") \
    .option("dbtable", "<schema>.<tablename>") \
    .option("user", "<username>") \
    .option("password", "<password>") \
    .option("driver", "org.postgresql.Driver") \
    .load()

Similar codes

1 vote122 views2 answers
Urllib.error.HTTPError: HTTP Error 404: Not Found
Python
1 vote118 views1 answer
How to check if string is camelcase python
Python
81 votes125 views6 answers
Python write to file
Python
48 votes126 views3 answers
Online python compiler with modules
Python
0 vote135 views1 answer
Add a value to the start of a list python
Python
22 votes209 views6 answers
How to execute a cmd command in python
Python
2 votes118 views1 answer
Selenium change window size
Python
4 votes121 views1 answer
Pandas add dataframe to the bottom of another
Python
4 votes103 views1 answer
Cannot import name 'flask' from partially initialized module 'flask' (most likely due to a circular import)
Python Flask
71 votes130 views6 answers
Python ide online
Python