hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9902) Shell script rewrite
Date Thu, 03 Oct 2013 07:21:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784883#comment-13784883

Steve Loughran commented on HADOOP-9902:

I'd be -1 for any attempt in the shell scripts to try and fix up duplicate JARs.
  # inconsistent operation across platforms
  # determining which version is latest is non-trivial
  # doesn't address the lurker of duplicate classes & resources (log4j, hdfs-site) on
the CP

the JAR has a policy of handling duplicates: first entry first. There is also the option of
sealing JARs without actually signing them -at which point you get an error when >1 JAR
tries to declare classes in the same package. We could seal the hadoop JARs, but it'd raise
more support calls.

What we can do is make sure that there are
 * No duplicate JARs get into the default tarball; YARN/lib extends HDFS/lib extends HADOOP_CORE/lib
without conflict.
 * No needless JARs (ex, junit 4.10 in YARN/lib)

> Shell script rewrite
> --------------------
>                 Key: HADOOP-9902
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9902
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: scripts
>    Affects Versions: 2.1.1-beta
>            Reporter: Allen Wittenauer
>            Assignee: Allen Wittenauer
>         Attachments: hadoop-9902-1.patch, more-info.txt
> Umbrella JIRA for shell script rewrite.  See more-info.txt for more details.

This message was sent by Atlassian JIRA

View raw message