hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10091) Generate Hbase execution plan for partition filter conditions in HbaseStore api calls - initial changes
Date Thu, 26 Mar 2015 16:21:54 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382149#comment-14382149
] 

Alan Gates commented on HIVE-10091:
-----------------------------------

When I run this against a real hbase instance I get:
{code}
Caused by: MetaException(message:java.lang.NullPointerException)
    at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:5141)
    at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rethrowException(HiveMetaStore.java:4369)
    at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:4352)
    at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.listPartitionsByExpr(HiveMetaStoreClient.java:1079)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.hive.metastore.HiveMetaStoreClientTimingProxy.invoke(HiveMetaStoreClientTimingProxy.java:102)
    at com.sun.proxy.$Proxy14.listPartitionsByExpr(Unknown Source)
    at org.apache.hadoop.hive.ql.metadata.Hive.getPartitionsByExpr(Hive.java:2129)
    at org.apache.hadoop.hive.ql.optimizer.ppr.PartitionPruner.getPartitionsFromServer(PartitionPruner.java:371)
    ... 48 more
Caused by: java.lang.NullPointerException
    at org.apache.hadoop.hive.metastore.hbase.HBaseFilterPlanUtil.getFilterPlan(HBaseFilterPlanUtil.java:486)
    at org.apache.hadoop.hive.metastore.hbase.HBaseStore.getPartitionsByExprInternal(HBaseStore.java:487)
    at org.apache.hadoop.hive.metastore.hbase.HBaseStore.getPartitionsByExpr(HBaseStore.java:474)
    at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:4347)
{code}

> Generate Hbase execution plan for partition filter conditions in HbaseStore api calls
- initial changes
> -------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-10091
>                 URL: https://issues.apache.org/jira/browse/HIVE-10091
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Metastore
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: hbase-metastore-branch
>
>         Attachments: HIVE-10091.1.patch, HIVE-10091.2.patch
>
>
> RawStore functions that support partition filtering are the following - 
> getPartitionsByExpr
> getPartitionsByFilter (takes filter string as argument, used from hcatalog)
> We need to generate a query execution plan in terms of Hbase scan api calls for a given
filter condition.
> NO PRECOMMIT TESTS



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message