flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ufuk Celebi <u.cel...@fu-berlin.de>
Subject Re: [GitHub] incubator-flink pull request: Do not limit the client's heap space...
Date Sun, 15 Jun 2014 19:08:57 GMT

On 15 Jun 2014, at 20:08, warneke <git@git.apache.org> wrote:

> Github user warneke commented on the pull request:
>    https://github.com/apache/incubator-flink/pull/18#issuecomment-46122924
>    Using RPCs to distribute jar files is still the quick hack from the very early days
of the project. I've already fixed this issue on several branches but I guess the change did
not make it to the upstream code. I could offer to take care of this problem, either through
some sort of HTTP transfer or by leveraging the distributed file system.

Hey Daniel! Too bad that the change did not make it upstream :( What did you use in the other
branches? HTTP? DFS? I would prefer HTTP over DFS. But we could also easily implement the
service on top of Netty (should basically be just an outbound handler which reads the file
and directly sends it out and vice versa for the inbound handler).
View raw message