flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aljoscha Krettek (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1710) Expression API Tests take very long
Date Wed, 18 Mar 2015 14:46:38 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14367213#comment-14367213
] 

Aljoscha Krettek commented on FLINK-1710:
-----------------------------------------

It is currently being compiled in one of ExpressionJoinFunction, ExpressionFilterFunction
or ExpressionSelectFunction. Compiling on the client is quite hard, since that would require
a way of shipping the compiled code. This means finding out what files are generated by the
Scala compiler, packing them into a jar and then shipping it along with the user-code-jar.

> Expression API Tests take very long
> -----------------------------------
>
>                 Key: FLINK-1710
>                 URL: https://issues.apache.org/jira/browse/FLINK-1710
>             Project: Flink
>          Issue Type: Bug
>          Components: Expression API
>    Affects Versions: 0.9
>            Reporter: Stephan Ewen
>            Assignee: Aljoscha Krettek
>             Fix For: 0.9
>
>
> The tests of the Expression API take an immense amount of time, compared to the other
API tests.
> Is that because they execute on large (generated) data sets, because the program compilation
overhead is high, or because there is an inefficiency in the execution still?
> Running org.apache.flink.api.scala.expressions.AggregationsITCase
> Running org.apache.flink.api.scala.expressions.SelectITCase
> Running org.apache.flink.api.scala.expressions.AsITCase
> Running org.apache.flink.api.scala.expressions.StringExpressionsITCase
> Running org.apache.flink.api.scala.expressions.CastingITCase
> Running org.apache.flink.api.scala.expressions.JoinITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.652 sec - in org.apache.flink.api.scala.expressions.AsITCase
> Running org.apache.flink.api.scala.expressions.GroupedAggreagationsITCase
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.797 sec - in org.apache.flink.api.scala.expressions.StringExpressionsITCase
> Running org.apache.flink.api.scala.expressions.PageRankExpressionITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.072 sec - in org.apache.flink.api.scala.expressions.SelectITCase
> Running org.apache.flink.api.scala.expressions.ExpressionsITCase
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.628 sec - in org.apache.flink.api.scala.expressions.CastingITCase
> Running org.apache.flink.api.scala.expressions.FilterITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 74.174 sec - in org.apache.flink.api.scala.expressions.AggregationsITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 93.878 sec - in org.apache.flink.api.scala.expressions.JoinITCase
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.4 sec - in org.apache.flink.api.scala.expressions.GroupedAggreagationsITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 44.179 sec - in org.apache.flink.api.scala.expressions.FilterITCase
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.801 sec - in org.apache.flink.api.scala.expressions.ExpressionsITCase
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 124.365 sec - in org.apache.flink.api.scala.expressions.PageRankExpressionITCase



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message