Mailing-List: contact issues-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Date: Sat, 5 Aug 2017 18:06:00 +0000 (UTC)
From: "Rong Rong (JIRA)" <jira@apache.org>
To: issues@flink.apache.org
Message-ID: <JIRA.13092691.1501956315000.100487.1501956360041@Atlassian.JIRA>
In-Reply-To: <JIRA.13092691.1501956315000@Atlassian.JIRA>
References: <JIRA.13092691.1501956315000@Atlassian.JIRA> <JIRA.13092691.1501956315025@jira-lw-us.apache.org>
Subject: [jira] [Created] (FLINK-7373) Using URLClassLoader to load UDF
 triggers HepPlanner unexpected ClassNotFoundException
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sat, 05 Aug 2017 18:06:07 -0000

Rong Rong created FLINK-7373:
--------------------------------

             Summary: Using URLClassLoader to load UDF triggers HepPlanner unexpected ClassNotFoundException
                 Key: FLINK-7373
                 URL: https://issues.apache.org/jira/browse/FLINK-7373
             Project: Flink
          Issue Type: Bug
          Components: Table API & SQL
    Affects Versions: 1.3.1
            Reporter: Rong Rong


Using URLClassLoader to load, say from Artifactory, and instantiate UDF instances will cause some Rule failed during runHepPlanner or runVolcanoPlanner.

One example could add an ITCase in:
{code:title=flink-libraries/flink-table/src/test/scala/org/apache/flink/table/runtime/batch/table/CalcITCase.scala}
  @Test
  def testUserDefinedFunctionDynamicClassloader() {
    val env = ExecutionEnvironment.getExecutionEnvironment
    val tableEnv = TableEnvironment.getTableEnvironment(env, config)

    val jarFileURI = "file://org/apache/flink/table/udf/HelloWorld.jar"
    val udfClassLoader: ClassLoader = new URLClassLoader(List(new URI(jarFileURI).toURL).toArray)
    val clazz = udfClassLoader.loadClass("org.apache.flink.table.udf.HelloWorld")
    val helloWorldUDF: ScalarFunction = clazz.newInstance().asInstanceOf[ScalarFunction]
    tableEnv.registerFunction("helloWorld", helloWorldUDF)
    val table = env.fromElements("a", "b", "c").toTable(tableEnv, 'text)
    val result = table.select("text.helloWorld()")
    val results = result.toDataSet[Row].collect()
    val expected = "Hello World!"
    TestBaseUtils.compareResultAsText(results.asJava, expected)
  }
{code}

where
{code:title=HelloWorld.java}
package org.apache.flink.table.udf;

import org.apache.flink.table.functions.ScalarFunction;

public class HelloWorld extends ScalarFunction {
  public String eval(String o) {
    if (o == null) {
      return "Hello World";
    } else {
      return "Hellow World " + o.toString();
    }
  }
}
{code}

This triggers the following Exception:
{panel:title=Exception}
org.apache.flink.api.common.InvalidProgramException: Table program cannot be compiled. This is a bug. Please file an issue.

	at org.apache.flink.table.codegen.Compiler$class.compile(Compiler.scala:36)
	at org.apache.flink.table.runtime.FlatMapRunner.compile(FlatMapRunner.scala:31)
	at org.apache.flink.table.runtime.FlatMapRunner.open(FlatMapRunner.scala:45)
	at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
	at org.apache.flink.api.common.operators.base.FlatMapOperatorBase.executeOnCollections(FlatMapOperatorBase.java:62)
......
Caused by: org.codehaus.commons.compiler.CompileException: Line 6, Column 22: Cannot determine simple type name "org"
	at org.codehaus.janino.UnitCompiler.compileError(UnitCompiler.java:11672)
	at org.codehaus.janino.UnitCompiler.getReferenceType(UnitCompiler.java:6416)
	at org.codehaus.janino.UnitCompiler.getReferenceType(UnitCompiler.java:6177)
......
{panel}


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)