flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-5998) Un-fat Hadoop from Flink fat jar
Date Fri, 24 Mar 2017 13:29:41 GMT

    [ https://issues.apache.org/jira/browse/FLINK-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940331#comment-15940331

ASF GitHub Bot commented on FLINK-5998:

Github user rmetzger commented on the issue:

    I have tested this change locally, but it does not exactly what my intention was.
    What I want is that the `lib/` folder contains a `flink-dist.jar` with all the Flink runtime
dependencies, and a `flink-dist-hadoop.jar` with the packaged Hadoop dependencies.
    This way, users have a good out of the box experience, but they can use their own Hadoop
jars easily.

> Un-fat Hadoop from Flink fat jar
> --------------------------------
>                 Key: FLINK-5998
>                 URL: https://issues.apache.org/jira/browse/FLINK-5998
>             Project: Flink
>          Issue Type: Improvement
>          Components: Build System
>            Reporter: Robert Metzger
>            Assignee: Haohui Mai
> As a first step towards FLINK-2268, I would suggest to put all hadoop dependencies into
a jar separate from Flink's fat jar.
> This would allow users to put a custom Hadoop jar in there, or even deploy Flink without
a Hadoop fat jar at all in environments where Hadoop is provided (EMR).

This message was sent by Atlassian JIRA

View raw message