hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-6894) Common foundation for Hadoop client tools
Date Wed, 18 Aug 2010 06:27:24 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alejandro Abdelnur updated HADOOP-6894:
---------------------------------------

    Attachment: HadoopClientToolsV2.pdf

Attached is a proposal (V2) Owen and I worked out together.

This proposal enables a complementary integration with HADOOP-6255

What has changed:

* hadoop client commands are just another tool
* 'tools/' dir is now 'share/'
* there can be a special tool 'commons' where 'plugin' tools like har, viewfs, hdfsprx are
added as dependencies
* all tools registered in 'commons' are always avail to any tool that depends on 'commons'
* there is an 'etc/' directory where tools configurations live

> Common foundation for Hadoop client tools
> -----------------------------------------
>
>                 Key: HADOOP-6894
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6894
>             Project: Hadoop Common
>          Issue Type: New Feature
>            Reporter: Alejandro Abdelnur
>         Attachments: HadoopClientTools.pdf, HadoopClientToolsV2.pdf
>
>
> As Hadoop widespreads and matures the number of tools and utilities for users keeps growing.
> Some of them are bundled with Hadoop core, some with Hadoop contrib, some on their own,
some are full fledged servers on their own. For example, just to name a few: distcp, streaming,
pipes, har, pig, hive, oozie.
> Today there is no standard mechanism for making these tools available to users. Neither
there is a standard mechanism for these tools to integrate and distributed them with each
other.
> The lack of a common foundation creates issues for developers and users.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message