hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abraham Elmahrek (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-10056) MiniMRClientClusterFactory in Hadoop 1.x forces local mode
Date Thu, 17 Oct 2013 20:16:42 GMT
Abraham Elmahrek created HADOOP-10056:

             Summary: MiniMRClientClusterFactory in Hadoop 1.x forces local mode
                 Key: HADOOP-10056
                 URL: https://issues.apache.org/jira/browse/HADOOP-10056
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 1.0.4
            Reporter: Abraham Elmahrek

Noticed the following in the 1.x branches:
public class MiniMRClientClusterFactory {

  public static MiniMRClientCluster create(Class<?> caller, int noOfNMs,
      Configuration conf) throws IOException {
    FileSystem fs = FileSystem.getLocal(new Configuration());
    MiniMRCluster miniMRCluster = new MiniMRCluster(noOfNMs, fs.getUri()
        .toString(), 1);
    return new MiniMRClusterAdapter(miniMRCluster);


The 2.x branches allow you to set what hadoop configuration to use (and which DFS cluster
to connect to). For instance, in the Sqoop project we are using the MiniDFSCluster in conjunction
with the MiniMRCluster.

This message was sent by Atlassian JIRA

View raw message