flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts
Date Thu, 05 Mar 2015 10:58:38 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14348594#comment-14348594
] 

ASF GitHub Bot commented on FLINK-1605:
---------------------------------------

Github user rmetzger commented on the pull request:

    https://github.com/apache/flink/pull/454#issuecomment-77344732
  
    I know, the stuff is very complicated.
    
    I've documented the setup here: https://cwiki.apache.org/confluence/display/FLINK/Dependency+Shading+in+Flink
    Please let me know if there are details missing in the text.
    
    Regarding `ship` and `lib`: If you want I can undo the change (I've spend some time implementing
the feature, so I'm actually in favor of keeping it).
    I've removed it because I thought non-yarn users might be confused by this directory (i
combined the hadoop2 and hadoop2-yarn binaries).
    
    The final flink-dist fat jar contains:
     * the streaming connectors (my java6 pr will remove them from there
     * no hbase
     * no hadoopcompat
    
    please don't merge the pull request! I've found an issue while writing the documentation.
I'm currently verifying my fix.


> Create a shaded Hadoop fat jar to resolve library version conflicts
> -------------------------------------------------------------------
>
>                 Key: FLINK-1605
>                 URL: https://issues.apache.org/jira/browse/FLINK-1605
>             Project: Flink
>          Issue Type: Improvement
>          Components: Build System
>    Affects Versions: 0.9
>            Reporter: Robert Metzger
>            Assignee: Robert Metzger
>
> As per mailing list discussion: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Create-a-shaded-Hadoop-fat-jar-to-resolve-library-version-conflicts-td3881.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message