hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From java8964 java8964 <java8...@hotmail.com>
Subject RE: Mapreduce outputs to a different cluster?
Date Sat, 26 Oct 2013 23:10:20 GMT
Just use "hdfs://machine.domain:8080/tmp/myfolder"

Date: Thu, 24 Oct 2013 20:25:35 -0700
From: myxjtu@yahoo.com
Subject: Re: Mapreduce outputs to a different cluster?
To: user@hadoop.apache.org

Thanks Shahab & Yong. If cluster B (in which I want to dump output) has url "hdfs://machine.domain:8080"
and data folder "/tmp/myfolder", what should I specify as the output path for MR job? 
     On Thursday, October 24, 2013 5:31 PM, java8964 java8964 <java8964@hotmail.com>
    Just specify the output location using the URI to another cluster. As long as the network
is accessible, you should be fine.YongDate: Thu, 24 Oct 2013 15:28:27 -0700From: myxjtu@yahoo.comSubject:
Mapreduce outputs to a different cluster?To: user@hadoop.apache.orgThe scenario is: I run
mapreduce job on cluster A (all source data is in cluster A) but I want the output of the
job to cluster B. Is it possible? If yes, please let me know how to do it.Here are some notes
of my mapreduce job:1. the data source is an HBase table2. It only has mapper no reducer.ThanksSenqiang

View raw message