hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-10115) Exclude duplicate jars in hadoop package under different component's lib
Date Tue, 10 Mar 2015 16:12:39 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer updated HADOOP-10115:
--------------------------------------
    Release Note: Jars in the various subproject lib directories are now de-duplicated against
Hadoop common.  Users who interact directly with those directories must be sure to pull in
common's dependencies as well.
    Hadoop Flags: Incompatible change

> Exclude duplicate jars in hadoop package under different component's lib
> ------------------------------------------------------------------------
>
>                 Key: HADOOP-10115
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10115
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 3.0.0, 2.2.0
>            Reporter: Vinayakumar B
>            Assignee: Vinayakumar B
>              Labels: common, hdfs, mapreduce, nfs, yarn
>             Fix For: 3.0.0
>
>         Attachments: HADOOP-10115-004.patch, HADOOP-10115-005.patch, HADOOP-10115-006.patch,
HADOOP-10115-007.patch, HADOOP-10115.patch, HADOOP-10115.patch, HADOOP-10115.patch
>
>
> In the hadoop package distribution there are more than 90% of the jars are duplicated
in multiple places.
> For Ex:
> almost all jars in share/hadoop/hdfs/lib are already there in share/hadoop/common/lib
> Same case for all other lib in share directory.
> Anyway for all the daemon processes all directories are added to classpath.
> So to reduce the package distribution size and the classpath overhead, remove the duplicate
jars from the distribution.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message