hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Shetye (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-21119) String UDAF and count distinct in the same select give error
Date Fri, 11 Jan 2019 23:58:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravi Shetye updated HIVE-21119:
-------------------------------
    Attachment: run.log

> String UDAF and count distinct in the same select give error
> ------------------------------------------------------------
>
>                 Key: HIVE-21119
>                 URL: https://issues.apache.org/jira/browse/HIVE-21119
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ravi Shetye
>            Priority: Major
>              Labels: wrongresults
>         Attachments: MaxUDA.java, run.log
>
>
> With the attached UDAF the following query crashes on hive.
> CRASHES
> {noformat}
> select rs_max(genderkey),count(distinct genderkey) from as_adventure.dimgender;
> {noformat}
> WORKS
> {noformat}
> select rs_max(genderkey) from as_adventure.dimgender;
> {noformat}
> The table looks like
> {noformat}
> 0: jdbc:hive2://localhost:10000> select * from dimgender;
> OK
> INFO  : Compiling command(queryId=hive_20190111225125_486e6e6b-97fa-4dda-9688-a733180bcfe7):
select * from dimgender
> INFO  : Concurrency mode is disabled, not creating a lock manager
> INFO  : Semantic Analysis Completed (retrial = false)
> INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:dimgender.genderkey,
type:string, comment:null), FieldSchema(name:dimgender.gendername, type:string, comment:null)],
properties:null)
> INFO  : Completed compiling command(queryId=hive_20190111225125_486e6e6b-97fa-4dda-9688-a733180bcfe7);
Time taken: 0.2 seconds
> INFO  : Concurrency mode is disabled, not creating a lock manager
> INFO  : Executing command(queryId=hive_20190111225125_486e6e6b-97fa-4dda-9688-a733180bcfe7):
select * from dimgender
> INFO  : Completed executing command(queryId=hive_20190111225125_486e6e6b-97fa-4dda-9688-a733180bcfe7);
Time taken: 0.004 seconds
> INFO  : OK
> INFO  : Concurrency mode is disabled, not creating a lock manager
> +----------------------+-----------------------+
> | dimgender.genderkey  | dimgender.gendername  |
> +----------------------+-----------------------+
> | M                    | Male                  |
> | F                    | Female                |
> | U                    | Unisex                |
> +----------------------+-----------------------+
> {noformat}
> {noformat}
> Vertex failed, vertexName=Reducer 2, vertexId=vertex_1547169244949_0024_2_01, diagnostics=[Task
failed, taskId=task_1547169244949_0024_2_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error:
Error while running task ( failure ) : attempt_1547169244949_0024_2_01_000000_0:java.lang.RuntimeException:
java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
Error while processing row (tag=0) {"key":{"_col0":"F"},"value":{"_col0":"F"}}
> 	at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
> 	at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
> 	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> 	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
> 	at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
> 	at java.security.AccessController.doPrivileged(Native Method)
> {noformat}
> ...
> {noformat}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute method
public boolean com.sample.MaxUDA$Evaluator.merge(java.lang.String) with arguments {F}:argument
type mismatch
> 	at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1111)
> 	at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFBridge$GenericUDAFBridgeEvaluator.merge(GenericUDAFBridge.java:176)
> 	at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:216)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message