hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bhupendra Kumar Jain (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14366) NPE in case visibility expression is not present in labels table during importtsv run
Date Mon, 05 Oct 2015 12:33:26 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943306#comment-14943306
] 

Bhupendra Kumar Jain commented on HBASE-14366:
----------------------------------------------

In the test cases there are 2 data lines (one with valid vis expression and another with invalid
vis expression) each having 2 columns.  After the bulk load happens, the invalid line will
be skipped as bad line. Test case compares the actual KV count written in HFile with expected
KV count to ensure that invalid vis expression KVs are skipped 
{code}
assertTrue(String.format(
        "KV count in output hfile=<%d> doesn't match with expected KV count=<%d>",
actualKVCount,
        expectedKVCount), actualKVCount == expectedKVCount);
{code}

> NPE in case visibility expression is not present in labels table during importtsv run
> -------------------------------------------------------------------------------------
>
>                 Key: HBASE-14366
>                 URL: https://issues.apache.org/jira/browse/HBASE-14366
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Y. SREENIVASULU REDDY
>            Assignee: Bhupendra Kumar Jain
>            Priority: Minor
>         Attachments: 0001-HBASE-14366.patch, 0001-HBASE-14366_1.patch, HBASE-14366_2(1).patch,
HBASE-14366_2.patch
>
>
> Below exception is shown in logs if visibility expression is not present in labels table
during importtsv run. Appropriate exception / message should be logged for the user to take
further action.
> {code}
> WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.NullPointerException
>         at org.apache.hadoop.hbase.mapreduce.DefaultVisibilityExpressionResolver$1.getLabelOrdinal(DefaultVisibilityExpressionResolver.java:127)
>         at org.apache.hadoop.hbase.security.visibility.VisibilityUtils.getLabelOrdinals(VisibilityUtils.java:358)
>         at org.apache.hadoop.hbase.security.visibility.VisibilityUtils.createVisibilityExpTags(VisibilityUtils.java:323)
>         at org.apache.hadoop.hbase.mapreduce.DefaultVisibilityExpressionResolver.createVisibilityExpTags(DefaultVisibilityExpressionResolver.java:137)
>         at org.apache.hadoop.hbase.mapreduce.TsvImporterMapper.populatePut(TsvImporterMapper.java:205)
>         at org.apache.hadoop.hbase.mapreduce.TsvImporterMapper.map(TsvImporterMapper.java:165)
>         at org.apache.hadoop.hbase.mapreduce.TsvImporterMapper.map(TsvImporterMapper.java:1)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message