hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2415) Move MiniDFS out of test JAR and into the main hadoop-hdfs JAR
Date Mon, 21 Nov 2011 17:56:52 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154320#comment-13154320

Alejandro Abdelnur commented on HDFS-2415:

So far downstream projects has been using Mini DFS/Cluster successfully for testing by including
the Hadoop TEST JARs in their classpath. The Hadoop TEST JARs are being published to the Maven
repos, thus easily available. 

If we move the miniclusters somewhere it should be to a 'test tools' module where they would
live on their own without all the Hadoop testcases, I would not move it to the main JARs.

If there is a problem with logging with the Mini clusters we should fix that.
> Move MiniDFS out of test JAR and into the main hadoop-hdfs JAR
> --------------------------------------------------------------
>                 Key: HDFS-2415
>                 URL: https://issues.apache.org/jira/browse/HDFS-2415
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: test
>            Reporter: Steve Loughran
>            Priority: Minor
> This is just an idea: move the MiniDFS cluster out of the Hadoop test JAR and into the
main redistributable.
> This would make it easier for people downstream to use it. It is the easiest way to bring
up a DFS cluster in a single JVM, and with the MiniMR cluster is a common way to test MR jobs
in the IDE against small datasets. 
> Moving the file while keeping the package name should not cause any problems; all it
will do is make applying outstanding patches to it slightly harder. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message