hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-16117) Fix Connection leak in mapred.TableOutputFormat when spark uses it.
Date Sun, 26 Jun 2016 23:51:52 GMT
Jonathan Hsieh created HBASE-16117:
--------------------------------------

             Summary: Fix Connection leak in mapred.TableOutputFormat when spark uses it.

                 Key: HBASE-16117
                 URL: https://issues.apache.org/jira/browse/HBASE-16117
             Project: HBase
          Issue Type: Bug
          Components: mapreduce
    Affects Versions: 2.0.0, 1.3.0, 1.2.2, 1.1.6
            Reporter: Jonathan Hsieh
            Assignee: Jonathan Hsieh
             Fix For: 2.0.0, 1.3.0, 1.2.2, 1.1.6


Spark seems to instantiate multiple instances of output formats within a single process. 
When mapred.TableOutputFormat (not mapreduce.TableOutputFormat) is used, this may cause connection
leaks that slowly exhaust the cluster's zk connections.  

This patch fixes that.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message