flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Warneke (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-939) Distribute required JAR files with seperate service
Date Sat, 28 Jun 2014 09:43:24 GMT

    [ https://issues.apache.org/jira/browse/FLINK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14046801#comment-14046801

Daniel Warneke commented on FLINK-939:

I fixed some minor bugs and added unit tests. The code passes all integration tests in stratosphere-runtime
and stratosphere-tests. Unfortunately, I don't have the resources to run the full integration
cycle. Therefore any kind of testing is highly appreciated.

> Distribute required JAR files with seperate service
> ---------------------------------------------------
>                 Key: FLINK-939
>                 URL: https://issues.apache.org/jira/browse/FLINK-939
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Ufuk Celebi
>            Assignee: Daniel Warneke
> Currently, required user JAR files are distributed via the RPC service in {{JobGraph.writeRequiredJarFiles(DataOutput,
AbstractJobVertex[])}}. The RPC service then tries to allocate a buffer on the client side
heap to write the on-disk JAR, which [can lead to problems|https://github.com/apache/incubator-flink/pull/18].
> This should be replaced with a seperate service.

This message was sent by Atlassian JIRA

View raw message