spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Li (JIRA)" <>
Subject [jira] [Updated] (SPARK-25547) Pluggable jdbc connection factory
Date Mon, 15 Oct 2018 18:12:00 GMT


Xiao Li updated SPARK-25547:
    Target Version/s: 3.0.0

> Pluggable jdbc connection factory
> ---------------------------------
>                 Key: SPARK-25547
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.3.1
>            Reporter: Frank Sauer
>            Priority: Major
> The ability to provide a custom connectionFactoryProvider via JDBCOptions so that JdbcUtils.createConnectionFactory
can produce a custom connection factory would be very useful. In our case we needed to have
the ability to load balance connections to an AWS Aurora Postgres cluster by round-robining
through the endpoints of the read replicas since their own loan balancing was insufficient.
We got away with it by copying most of the spark jdbc package and provide this feature there
and changing the format from jdbc to our new package. However it would be nice  if this were
supported out of the box via a new option in JDBCOptions providing the classname for a ConnectionFactoryProvider.
I'm creating this Jira in order to submit a PR which I have ready to go.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message