Mailing-List: contact notifications-help@asterixdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@asterixdb.apache.org
Date: Tue, 7 Nov 2017 21:21:00 +0000 (UTC)
From: =?utf-8?Q?Tomasz_Paw=C5=82owski_=28JIRA=29?= <jira@apache.org>
To: notifications@asterixdb.incubator.apache.org
Message-ID: <JIRA.13116797.1510089057000.174945.1510089660166@Atlassian.JIRA>
In-Reply-To: <JIRA.13116797.1510089057000@Atlassian.JIRA>
References: <JIRA.13116797.1510089057000@Atlassian.JIRA> <JIRA.13116797.1510089057081@jira-lw-us.apache.org>
Subject: [jira] [Commented] (ASTERIXDB-2157) Parsing metadata of UDF with
 UnorderedList return type
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Tue, 07 Nov 2017 22:12:49 -0000


    [ https://issues.apache.org/jira/browse/ASTERIXDB-2157?page=3Dcom.atlas=
sian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D=
16242901#comment-16242901 ]=20

Tomasz Paw=C5=82owski commented on ASTERIXDB-2157:
---------------------------------------------

I have already created a pull request for this bug https://github.com/apach=
e/asterixdb/pull/6 including a proper unit test.

> Parsing metadata of UDF with UnorderedList return type
> ------------------------------------------------------
>
>                 Key: ASTERIXDB-2157
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-2157
>             Project: Apache AsterixDB
>          Issue Type: Bug
>          Components: MTD - Metadata
>            Reporter: Tomasz Paw=C5=82owski
>            Priority: Minor
>              Labels: easyfix, newbie
>
> While defining a library UDF with return_type representing a unordered li=
st (eg. {{ ASTRING }}). UDF is created with result type {{ {{ ASTRING }} }}=
.=20
> This error can be replicated with libraryFunction:
>   <libraryFunction>
>       <function_type>SCALAR</function_type>
>       <name>test</name>
>       <arguments>ASTRING</arguments>
>       <return_type>{{ ASTRING }}</return_type>
>       <definition>org.apache.asterix.external.library.TestFactory</defini=
tion>
>     </libraryFunction>
> TestFactory.java:
> package org.apache.asterix.external.library;
> import org.apache.asterix.external.api.IExternalScalarFunction;
> import org.apache.asterix.external.api.IFunctionFactory;
> public class TestFactory implements IFunctionFactory {
>     @Override
>     public IExternalScalarFunction getExternalFunction() {
>         return new TestFunction();
>     }
> }
> // END of TestFactory.java
> TestFunction.java:
> package org.apache.asterix.external.library;
> import org.apache.asterix.external.api.IExternalScalarFunction;
> import org.apache.asterix.external.api.IFunctionHelper;
> import org.apache.asterix.external.library.java.JObjects;
> import org.apache.asterix.om.types.BuiltinType;
> public class TestFunction implements IExternalScalarFunction {
>     private JObjects.JUnorderedList results;
>     @Override
>     public void deinitialize() {}
>     @Override
>     public void evaluate(IFunctionHelper functionHelper) throws Exception=
 {
>         JObjects.JString input =3D (JObjects.JString) functionHelper.getA=
rgument(0);
>         results.reset();
>         JObjects.JUnorderedList test =3D new JObjects.JUnorderedList(Buil=
tinType.ASTRING);
>         test.add(input);
>         test.add(input);
>         test.add(input);
>         results.add(test);
>         functionHelper.setResult(results);
>     }
>     @Override
>     public void initialize(IFunctionHelper functionHelper) throws Excepti=
on{
>         results =3D (JObjects.JUnorderedList) functionHelper.getResultObj=
ect();
>     }
> }
> // END of TestFunction.java
> And executing (AQL):
> use dataverse test;
> testlib#test("test")
> Which results in:
> {{ {{ "test", "test", "test" }} }}
> At the same time writing TestFunction evaluate to return {{ ASTRING }} re=
sults in error:
> org.apache.hyracks.algebricks.common.exceptions.AlgebricksException: java=
.io.EOFException
> =09at org.apache.asterix.optimizer.rules.ConstantFoldingRule$ConstantFold=
ingVisitor.visitScalarFunctionCallExpression(ConstantFoldingRule.java:231)
> =09at org.apache.asterix.optimizer.rules.ConstantFoldingRule$ConstantFold=
ingVisitor.visitScalarFunctionCallExpression(ConstantFoldingRule.java:153)
> =09at org.apache.hyracks.algebricks.core.algebra.expressions.ScalarFuncti=
onCallExpression.accept(ScalarFunctionCallExpression.java:55)
> =09at org.apache.asterix.optimizer.rules.ConstantFoldingRule$ConstantFold=
ingVisitor.transform(ConstantFoldingRule.java:163)
> =09at org.apache.hyracks.algebricks.core.algebra.operators.logical.Abstra=
ctAssignOperator.acceptExpressionTransform(AbstractAssignOperator.java:67)
> =09at org.apache.asterix.optimizer.rules.ConstantFoldingRule.rewritePost(=
ConstantFoldingRule.java:150)
> =09at org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleContro=
ller.rewriteOperatorRef(AbstractRuleController.java:126)
> =09at org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleContro=
ller.rewriteOperatorRef(AbstractRuleController.java:100)
> =09at org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleContro=
ller.rewriteOperatorRef(AbstractRuleController.java:100)
> =09at org.apache.hyracks.algebricks.compiler.rewriter.rulecontrollers.Seq=
uentialFixpointRuleController.rewriteWithRuleCollection(SequentialFixpointR=
uleController.java:53)
> =09at org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer=
.runOptimizationSets(HeuristicOptimizer.java:102)
> =09at org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer=
.optimize(HeuristicOptimizer.java:82)
> =09at org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactory=
Builder$1$1.optimize(HeuristicCompilerFactoryBuilder.java:90)
> =09at org.apache.asterix.api.common.APIFramework.compileQuery(APIFramewor=
k.java:267)
> =09at org.apache.asterix.app.translator.QueryTranslator.rewriteCompileQue=
ry(QueryTranslator.java:1834)
> =09at org.apache.asterix.app.translator.QueryTranslator.lambda$handleQuer=
y$1(QueryTranslator.java:2307)
> =09at org.apache.asterix.app.translator.QueryTranslator.createAndRunJob(Q=
ueryTranslator.java:2407)
> =09at org.apache.asterix.app.translator.QueryTranslator.deliverResult(Que=
ryTranslator.java:2340)
> =09at org.apache.asterix.app.translator.QueryTranslator.handleQuery(Query=
Translator.java:2319)
> =09at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute=
(QueryTranslator.java:370)
> =09at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute=
(QueryTranslator.java:253)
> =09at org.apache.asterix.api.http.server.ApiServlet.post(ApiServlet.java:=
153)
> =09at org.apache.hyracks.http.server.AbstractServlet.handle(AbstractServl=
et.java:78)
> =09at org.apache.hyracks.http.server.HttpRequestHandler.handle(HttpReques=
tHandler.java:70)
> =09at org.apache.hyracks.http.server.HttpRequestHandler.call(HttpRequestH=
andler.java:55)
> =09at org.apache.hyracks.http.server.HttpRequestHandler.call(HttpRequestH=
andler.java:36)
> =09at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto=
r.java:1142)
> =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut=
or.java:617)
> =09at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: java.i=
o.EOFException
> =09at org.apache.hyracks.api.exceptions.HyracksDataException.create(Hyrac=
ksDataException.java:45)
> =09at org.apache.asterix.dataflow.data.nontagged.serde.AUnorderedListSeri=
alizerDeserializer.deserialize(AUnorderedListSerializerDeserializer.java:10=
2)
> =09at org.apache.asterix.dataflow.data.nontagged.serde.AUnorderedListSeri=
alizerDeserializer.deserialize(AUnorderedListSerializerDeserializer.java:43=
)
> =09at org.apache.asterix.dataflow.data.nontagged.serde.AUnorderedListSeri=
alizerDeserializer.deserialize(AUnorderedListSerializerDeserializer.java:96=
)
> =09at org.apache.asterix.dataflow.data.nontagged.serde.AUnorderedListSeri=
alizerDeserializer.deserialize(AUnorderedListSerializerDeserializer.java:43=
)
> =09at org.apache.asterix.formats.nontagged.SerializerDeserializerProvider=
$1.deserialize(SerializerDeserializerProvider.java:191)
> =09at org.apache.asterix.formats.nontagged.SerializerDeserializerProvider=
$1.deserialize(SerializerDeserializerProvider.java:173)
> =09at org.apache.asterix.optimizer.rules.ConstantFoldingRule$ConstantFold=
ingVisitor.visitScalarFunctionCallExpression(ConstantFoldingRule.java:228)
> =09... 29 more
> Caused by: java.io.EOFException
> =09at java.io.DataInputStream.readInt(DataInputStream.java:392)
> =09at org.apache.asterix.dataflow.data.nontagged.serde.AUnorderedListSeri=
alizerDeserializer.deserialize(AUnorderedListSerializerDeserializer.java:92=
)
> =09... 35 more


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)