hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15221) HTableMultiplexer improvements (stale region locations and resource leaks)
Date Fri, 12 Feb 2016 07:32:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144209#comment-15144209

Hudson commented on HBASE-15221:

SUCCESS: Integrated in HBase-1.1-JDK8 #1748 (See [https://builds.apache.org/job/HBase-1.1-JDK8/1748/])
HBASE-15221 HTableMultiplexer improvements (stale region locations and (tedyu: rev 360a5782c19bd61df9e6b92cc2a72ff0260a082d)
* hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestHTableMultiplexerViaMocks.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTableMultiplexer.java
* hbase-client/pom.xml

> HTableMultiplexer improvements (stale region locations and resource leaks)
> --------------------------------------------------------------------------
>                 Key: HBASE-15221
>                 URL: https://issues.apache.org/jira/browse/HBASE-15221
>             Project: HBase
>          Issue Type: Bug
>          Components: Client
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>            Priority: Critical
>             Fix For: 2.0.0, 1.2.0, 1.3.0, 1.1.4
>         Attachments: HBASE-15221.001.patch, HBASE-15221.002.patch, HBASE-15221.003.patch,
HBASE-15221.branch-1.patch, HBASE-15221.v4.patch
> It looks like HTableMultiplexer has a couple of issues.
> Upon failing to send a Put to the appropriate RS, the Put is re-queued back into the
system. Normally this is fine as such an exception is transient and the Put would eventually
succeed. However, in the case where the Put was rejected because of a NotServingRegionException
(e.g. split, balance, merge), the re-queuing of the Put will end up using the same cached
HRegionLocation. This means that the Put will just be repeatedly sent back to the same RS
over and over again, eventually being dropped on the floor. Need to invalidate the location
cache (or make sure we refresh it) when we re-queue the Put.
> The internal ClusterConnection is also leaked. If a user creates many HTableMultiplexers,
they'll eventually run into issues (memory, zk connections, etc) because they'll never get
cleaned up. HTableMultiplexer needs a close method.

This message was sent by Atlassian JIRA

View raw message