/Python/Connect spark to postgres; connect spark to database

Connect spark to postgres; connect spark to database

spark = SparkSession.builder.config(conf=spark_conf).getOrCreate()

#make sure the necessary jar files are loaded
#@ opt/spark/jars folder

df = spark.read \
    .format("jdbc") \
    .option("url", "jdbc:postgresql://<host>:<port>/<db_name>") \
    .option("dbtable", "<schema>.<tablename>") \
    .option("user", "<username>") \
    .option("password", "<password>") \
    .option("driver", "org.postgresql.Driver") \
    .load()

Similar codes

0 vote188 views1 answer
Rnadom number python
Python
0 vote181 views1 answer
How to import a all the modules in a packege python
Python
139 votes192 views6 answers
Open text file in python
Python
4 votes184 views1 answer
Video streaming flask
Python
0 vote169 views1 answer
How to access value from <class 'pandas.core.indexes.numeric.Int64Index'>?q=int64.index
Python
0 vote178 views1 answer
NetworkX Dijkstra's Algorithm
Python
43 votes269 views6 answers
Adding new column to existing DataFrame in Pandas
Python
1 vote177 views3 answers
Rgb to grayscale python
Python
0 vote181 views1 answer
Issue AttributeError: ‘numpy.ndarray’ object has no attribute ‘index’
Python
17 votes201 views4 answers
How to check python version linux
Python