hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "hizero (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-14555) JDBC:ClassNotFoundException when executing a map join query with UDF
Date Wed, 17 Aug 2016 06:08:20 GMT

     [ https://issues.apache.org/jira/browse/HIVE-14555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

hizero updated HIVE-14555:
--------------------------
    Attachment: hive_exec_Utilities.patch

I add cloningQueryPlanKryo.remove() in funcition deserializePlan so that cloningQueryPlanKryo
will be reinitialized at runtime.

> JDBC:ClassNotFoundException when executing a map join query with UDF
> --------------------------------------------------------------------
>
>                 Key: HIVE-14555
>                 URL: https://issues.apache.org/jira/browse/HIVE-14555
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Planning
>    Affects Versions: 1.1.0
>            Reporter: hizero
>            Assignee: hizero
>             Fix For: 1.1.0
>
>         Attachments: hive_exec_Utilities.patch
>
>
> when I submit a map join query with UDF using JDBC  and sometimes it throws:
> Error while compiling statement: FAILED: SemanticException Generate Map Join Task Error:
Unable to find class: com.kingnetdc.hive.udf.FilterByMap Serialization trace: genericUDF (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc)
colExprMap (org.apache.hadoop.hive.ql.exec.SelectOperator) childOperators (org.apache.hadoop.hive.ql.exec.FilterOperator)
childOperators (org.apache.hadoop.hive.ql.exec.JoinOperator) reducer (org.apache.hadoop.hive.ql.plan.ReduceWork)
reduceWork (org.apache.hadoop.hive.ql.plan.MapredWork)
>  I have found the fact that it fails at cloning plan when invoking Utilities.deserializePlan.
> An existing thread deals with the query and its static threadlocal variable,cloningQueryPlanKryo
has been initialed at most once per thread.When this thread registered UDF setting in aux_jar_paths
 it wont reinitialize the cloningQueryPlanKryo.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message