hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Javier (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-14616) CBO phase fails with NPE when quering a table with array field
Date Wed, 24 Aug 2016 08:03:20 GMT
Javier created HIVE-14616:
-----------------------------

             Summary: CBO phase fails with NPE when quering a table with array field
                 Key: HIVE-14616
                 URL: https://issues.apache.org/jira/browse/HIVE-14616
             Project: Hive
          Issue Type: Bug
          Components: CBO
    Affects Versions: 1.2.1
            Reporter: Javier
            Priority: Minor


A "Error: Error while compiling statement: FAILED: NullPointerException null (state=42000,code=40000)"
message appears when issuing a query involving a table with array. Statistics where gathered
issuing:

analyze table test.table_with_array compute statistics;
analyze table test.table_with_array compute statistics for columns
<all_columns_but_array_field>;

We couldn't compute statistics for all columns because we got a "FAILED: UDFArgumentTypeException
Only primitive type arguments are accepted but array<string> is passed."

The hive log shows:

2016-08-24 02:35:29,987 INFO  [HiveServer2-Handler-Pool: Thread-145434]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(747)) - 485: get_table_statistics_req: db=test table=table_with_array
2016-08-24 02:35:29,988 INFO  [HiveServer2-Handler-Pool: Thread-145434]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(372)) - ugi=user    ip=unknown-ip-addr      cmd=get_table_statistics_req:
db=test table=table_with_array
2016-08-24 02:35:30,002 ERROR [HiveServer2-Handler-Pool: Thread-145434]: ql.Driver (SessionState.java:printError(932))
- FAILED: NullPointerException null
java.lang.NullPointerException
        at org.apache.hadoop.hive.ql.stats.StatsUtils.getColStatistics(StatsUtils.java:695)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.convertColStats(StatsUtils.java:741)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.getTableColumnStats(StatsUtils.java:730)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.collectStatistics(StatsUtils.java:185)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.collectStatistics(StatsUtils.java:138)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.collectStatistics(StatsUtils.java:126)
        at org.apache.hadoop.hive.ql.optimizer.stats.annotation.StatsRulesProcFactory$TableScanStatsRule.process(StatsRulesProcFactory.java:110)
        at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
        at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:95)
        at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:79)
        at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:56)
        at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:110)

Best wishes



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message