hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6200) Create a separate jar for hdfs-client
Date Fri, 06 Mar 2015 19:32:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350774#comment-14350774
] 

Alejandro Abdelnur commented on HDFS-6200:
------------------------------------------

Haohui, 

Doing what hadoop-client wont solve the problems you want to tackle, it will just remove the
JARs used on the HDFS server side only. If you just care about those server side dependencies,
hadoop-client should be enough and you could exclude YARN/MR artifacts in your dependency.

If you want take care of guava, commons-*, etc, etc, you'll need to classloader magic for
the filesystem impls, and this should be done in common where the Hadoop FileSystem API lives
so all Hadoop FileSystem implementations get this kind of isolation.



> Create a separate jar for hdfs-client
> -------------------------------------
>
>                 Key: HDFS-6200
>                 URL: https://issues.apache.org/jira/browse/HDFS-6200
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Haohui Mai
>            Assignee: Haohui Mai
>         Attachments: HDFS-6200.000.patch, HDFS-6200.001.patch, HDFS-6200.002.patch, HDFS-6200.003.patch,
HDFS-6200.004.patch, HDFS-6200.005.patch, HDFS-6200.006.patch, HDFS-6200.007.patch
>
>
> Currently the hadoop-hdfs jar contain both the hdfs server and the hdfs client. As discussed
in the hdfs-dev mailing list (http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-dev/201404.mbox/browser),
downstream projects are forced to bring in additional dependency in order to access hdfs.
The additional dependency sometimes can be difficult to manage for projects like Apache Falcon
and Apache Oozie.
> This jira proposes to create a new project, hadoop-hdfs-cliient, which contains the client
side of the hdfs code. Downstream projects can use this jar instead of the hadoop-hdfs to
avoid unnecessary dependency.
> Note that it does not break the compatibility of downstream projects. This is because
old downstream projects implicitly depend on hadoop-hdfs-client through the hadoop-hdfs jar.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message