Mailing-List: contact issues-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Date: Mon, 16 Oct 2017 23:31:00 +0000 (UTC)
From: "Rong Rong (JIRA)" <jira@apache.org>
To: issues@flink.apache.org
Message-ID: <JIRA.13092691.1501956315000.11756.1508196660534@Atlassian.JIRA>
In-Reply-To: <JIRA.13092691.1501956315000@Atlassian.JIRA>
References: <JIRA.13092691.1501956315000@Atlassian.JIRA> <JIRA.13092691.1501956315025@jira-lw-us.apache.org>
Subject: [jira] [Commented] (FLINK-7373) Using URLClassLoader to load UDF
 triggers HepPlanner unexpected ClassNotFoundException
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 16 Oct 2017 23:31:06 -0000


    [ https://issues.apache.org/jira/browse/FLINK-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206774#comment-16206774 ] 

Rong Rong commented on FLINK-7373:
----------------------------------

Hi [~fhueske], no we haven't found a great solution so we decided to work around it by not allowing any extra jar which is not already included in the UDF classpath. 

> Using URLClassLoader to load UDF triggers HepPlanner unexpected ClassNotFoundException
> --------------------------------------------------------------------------------------
>
>                 Key: FLINK-7373
>                 URL: https://issues.apache.org/jira/browse/FLINK-7373
>             Project: Flink
>          Issue Type: Bug
>          Components: Table API & SQL
>    Affects Versions: 1.3.1
>            Reporter: Rong Rong
>            Assignee: Rong Rong
>
> Using URLClassLoader to load, say from Artifactory, and instantiate UDF instances will cause some Rule failed during runHepPlanner or runVolcanoPlanner.
> One example could add an ITCase in:
> {code:title=flink-libraries/flink-table/src/test/scala/org/apache/flink/table/runtime/batch/table/CalcITCase.scala}
>   @Test
>   def testUserDefinedFunctionDynamicClassloader() {
>     val env = ExecutionEnvironment.getExecutionEnvironment
>     val tableEnv = TableEnvironment.getTableEnvironment(env, config)
>     val jarFileURI = "file://org/apache/flink/table/udf/HelloWorld.jar"
>     val udfClassLoader: ClassLoader = new URLClassLoader(List(new URI(jarFileURI).toURL).toArray)
>     val clazz = udfClassLoader.loadClass("org.apache.flink.table.udf.HelloWorld")
>     val helloWorldUDF: ScalarFunction = clazz.newInstance().asInstanceOf[ScalarFunction]
>     tableEnv.registerFunction("helloWorld", helloWorldUDF)
>     val table = env.fromElements("a", "b", "c").toTable(tableEnv, 'text)
>     val result = table.select("text.helloWorld()")
>     val results = result.toDataSet[Row].collect()
>     val expected = "Hello World"
>     TestBaseUtils.compareResultAsText(results.asJava, expected)
>   }
> {code}
> where
> {code:title=HelloWorld.java}
> package org.apache.flink.table.udf;
> import org.apache.flink.table.functions.ScalarFunction;
> public class HelloWorld extends ScalarFunction {
>   public String eval() {
>     return "Hello World";
>   }
> }
> {code}
> This triggers the following Exception:
> {panel:title=Exception}
> org.apache.flink.api.common.InvalidProgramException: Table program cannot be compiled. This is a bug. Please file an issue.
> 	at org.apache.flink.table.codegen.Compiler$class.compile(Compiler.scala:36)
> 	at org.apache.flink.table.runtime.FlatMapRunner.compile(FlatMapRunner.scala:31)
> 	at org.apache.flink.table.runtime.FlatMapRunner.open(FlatMapRunner.scala:45)
> 	at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
> 	at org.apache.flink.api.common.operators.base.FlatMapOperatorBase.executeOnCollections(FlatMapOperatorBase.java:62)
> ......
> Caused by: org.codehaus.commons.compiler.CompileException: Line 6, Column 22: Cannot determine simple type name "org"
> 	at org.codehaus.janino.UnitCompiler.compileError(UnitCompiler.java:11672)
> 	at org.codehaus.janino.UnitCompiler.getReferenceType(UnitCompiler.java:6416)
> 	at org.codehaus.janino.UnitCompiler.getReferenceType(UnitCompiler.java:6177)
> ......
> {panel}


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)