flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jun Qin (Jira)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-18702) Flink elasticsearch connector leaks threads and classloaders thereof
Date Fri, 24 Jul 2020 09:35:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-18702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jun Qin updated FLINK-18702:
----------------------------
    Description: 
Flink elasticsearch connector leaking threads and classloaders thereof.  This results in
OOM Metaspace when ES sink fails and restarted many times. 

This issue is visible in Flink 1.10 but not in 1.11 because Flink 1.11 does not create new
class loaders in case of recoveries (FLINK-16408)

 

Reproduction:
 * Start a job with ES sink in a Flink 1.10 cluster, without starting the ES cluster.

 

 

  was:
Flink elasticsearch connector leaking threads and classloaders thereof.  This results in
OOM Metaspace when ES sink fails and restarted many times. 

This issue is visible in Flink 1.10 but not in 1.11 because Flink 1.11 does not create new
class loaders in case of recoveries ([FLINK-16408|https://issues.apache.org/jira/browse/FLINK-16408])


> Flink elasticsearch connector leaks threads and classloaders thereof
> --------------------------------------------------------------------
>
>                 Key: FLINK-18702
>                 URL: https://issues.apache.org/jira/browse/FLINK-18702
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / ElasticSearch
>    Affects Versions: 1.10.1
>            Reporter: Jun Qin
>            Priority: Major
>
> Flink elasticsearch connector leaking threads and classloaders thereof.  This results
in OOM Metaspace when ES sink fails and restarted many times. 
> This issue is visible in Flink 1.10 but not in 1.11 because Flink 1.11 does not create
new class loaders in case of recoveries (FLINK-16408)
>  
> Reproduction:
>  * Start a job with ES sink in a Flink 1.10 cluster, without starting the ES cluster.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message