hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1730) [hbase] unexpected null value causes META scanner to exit (silently)
Date Sat, 18 Aug 2007 00:22:30 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HADOOP-1730:
--------------------------

    Attachment: nullsplit.patch

Here's a fix.

{code}
HADOOP-1730 unexpected null value causes META scanner to exit (silently)

Added handling for legal null value scanning META table and added
logging of unexpected exceptions that arise scanning.

M src/contrib/hbase/src/test/org/apache/hadoop/hbase/TestSplit.java
    Refactored to do a staged removal of daughter references.
    (compact, recalibrate): Added.
    (getSplitParent): Refactored as getSplitParentInfo.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HConnectionManager.java
    Added formatting of the find table result string so shorter
    (when 30-odd regions fills page with its output).
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HTable.java
    Formatting to clean eclipse warnings.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMaster.java
    The split column in a parent meta table entry can be null (Happens
    if a daughter split no longer has references -- it removes its
    entry from parent).  Add handling and clean up around split
    management code.  Added logging of unexpected exceptions
    scanning a region.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegion.java
    Added fix for NPE when client asks for scanner but passes
    non-existent columns.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/util/Writables.java
    (getHRegionInfo, getHRegionInfoOrNull): Added.
{code}

> [hbase] unexpected null value causes META scanner to exit (silently)
> --------------------------------------------------------------------
>
>                 Key: HADOOP-1730
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1730
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/hbase
>            Reporter: stack
>            Assignee: stack
>         Attachments: nullsplit.patch
>
>
> META scanner exits silently if a cell value is unexpectedly empty.
> At least the out log had this:
> {code}
> Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build
a writable with empty bytes array
>     at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
>     at java.lang.Thread.run(Thread.java:619)
> {code}
> Need to add at a minimum logging of meta scanner exits with the why.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message