flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harikrishnan S <hihari...@gmail.com>
Subject Re: JDBC sink in flink
Date Tue, 05 Jul 2016 10:01:40 GMT
Oh. So you mean if I write a custom sink for a db, I just need to create
one connection in the open() method and then the invoke() method will reuse
it ? Basically I need to do 35k-50k+ upserts in postgres. Can I reuse
JDBCOutputFormat
for this purpose ? I couldn't find a proper document describing how sinks
works in flink.



On Tue, Jul 5, 2016 at 2:41 PM, Stefano Bortoli <s.bortoli@gmail.com> wrote:

> The connection will be managed by the splitManager, no need of using a
> pool. However, if you had to, probably you should look into
> establishConnection() method of the JDBCInputFormat.
>
>
>
> 2016-07-05 10:52 GMT+02:00 Flavio Pompermaier <pompermaier@okkam.it>:
>
>> why do you need a connection pool?
>> On 5 Jul 2016 11:41, "Harikrishnan S" <hihari777@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Are there any examples of implementing a jdbc sink in flink using a
>>> connection pool ?
>>>
>>> Thanks
>>>
>>> On Tue, Jul 5, 2016 at 2:00 PM, Harikrishnan S <hihari777@gmail.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> Are there any examples of implementing a jdbc sink in flink using a
>>>> connection pool ?
>>>>
>>>> Thanks
>>>>
>>>> On Tue, Jul 5, 2016 at 1:57 PM, Harikrishnan S <hihari777@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Are there any examples of implementing a jdbc sink in flink using a
>>>>> connection pool ?
>>>>>
>>>>> Thanks
>>>>>
>>>>
>>>>
>>>
>

Mime
View raw message