hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mathias Herberts (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-17704) Regions stuck in FAILED_OPEN when HDFS blocks are missing
Date Mon, 27 Feb 2017 22:19:45 GMT
Mathias Herberts created HBASE-17704:

             Summary: Regions stuck in FAILED_OPEN when HDFS blocks are missing
                 Key: HBASE-17704
                 URL: https://issues.apache.org/jira/browse/HBASE-17704
             Project: HBase
          Issue Type: Bug
          Components: regionserver
    Affects Versions: 1.1.8
            Reporter: Mathias Herberts

We recently experienced the loss of a whole rack (6 DNs + RS) in a 120 node cluster. This
lead to the regions which were present on the 6 RS which became unavailable to be reassigned
to live RSs. When attempting to open some of the reassigned regions, some RS encountered missing
blocks and issued "No live nodes contain current block Block locations" putting the regions
in state FAILED_OPEN.

Once the disappeared DNs went back online, the regions were left in FAILED_OPEN, needing a
restart of all the affected RSs to solve the problem.

This message was sent by Atlassian JIRA

View raw message