hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16562) Issues with nullif / fetch task
Date Sat, 06 May 2017 07:59:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999338#comment-15999338
] 

Hive QA commented on HIVE-16562:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12866589/HIVE-16562.2.patch

{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 10653 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr] (batchId=143)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_join30] (batchId=148)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/5069/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/5069/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-5069/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12866589 - PreCommit-HIVE-Build

> Issues with nullif / fetch task
> -------------------------------
>
>                 Key: HIVE-16562
>                 URL: https://issues.apache.org/jira/browse/HIVE-16562
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Carter Shanklin
>            Assignee: Zoltan Haindrich
>         Attachments: HIVE-16562.1.patch, HIVE-16562.2.patch
>
>
> HIVE-13555 adds support for nullif. I'm encountering issues with nullif on master (3.0.0-SNAPSHOT
rdac3786d86462e4d08d62d23115e6b7a3e534f5d)
> Cluster side jobs work fine but client side don't.
> Consider these two tables:
> e011_02:
> Columns c1 = float, c2 = double
> 1.0	1.0
> 1.5	1.5
> 2.0	2.0
> test:
> Columns c1 = int, c2 = int
> Data:
> 1	1
> 2	2
> And this query:
> select nullif(c1, c2) from e011_02;
> With e011_02 I get:
> {code}
> java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: Error evaluating
NULLIF(c1,c2)
> 	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:165)
> 	at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2177)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:253)
> 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
> 	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821)
> 	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
> 	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Error evaluating NULLIF(c1,c2)
> 	at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:93)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:897)
> 	at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:130)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:442)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:434)
> 	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:147)
> 	... 13 more
> Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.lazy.LazyFloat
cannot be cast to org.apache.hadoop.io.FloatWritable
> 	at org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableFloatObjectInspector.get(WritableFloatObjectInspector.java:36)
> 	at org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorUtils.comparePrimitiveObjects(PrimitiveObjectInspectorUtils.java:412)
> 	at org.apache.hadoop.hive.ql.udf.generic.GenericUDFNullif.evaluate(GenericUDFNullif.java:93)
> 	at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:187)
> 	at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:80)
> 	at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:68)
> 	at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
> 	... 18 more
> {code}
> With 
> select nullif(c1, c2) from test;
> I get:
> {code}
> 2017-05-01T03:32:19,905 ERROR [cbaf5380-5b06-4531-aeb9-524c62314a46 main] CliDriver:
Failed with exception java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException:
Error evaluating NULLIF(c1,c2)
> java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: Error evaluating
NULLIF(c1,c2)
> 	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:165)
> 	at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2177)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:253)
> 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:184)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
> 	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821)
> 	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
> 	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Error evaluating NULLIF(c1,c2)
> 	at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:93)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:897)
> 	at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:130)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:442)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:434)
> 	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:147)
> 	... 13 more
> Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.lazy.LazyInteger
cannot be cast to org.apache.hadoop.io.IntWritable
> 	at org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableIntObjectInspector.get(WritableIntObjectInspector.java:36)
> 	at org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorUtils.comparePrimitiveObjects(PrimitiveObjectInspectorUtils.java:404)
> 	at org.apache.hadoop.hive.ql.udf.generic.GenericUDFNullif.evaluate(GenericUDFNullif.java:93)
> 	at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:187)
> 	at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:80)
> 	at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:68)
> 	at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
> 	... 18 more
> {code}
> Now if I set hive.fetch.task.conversion=none; and force a cluster side job, everything
works fine
> /cc [~kgyrtkirk] in case you have any ideas



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message