hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Templeton <dan...@cloudera.com>
Subject Re: [QUESTION] Interworking 2 seperate Hadoop instances
Date Thu, 16 Feb 2017 16:13:54 GMT
If they share the same master node, then they're really only one 
cluster, so everything will work as expected.  If you want the two 
clusters to remain independent, what you want is federation.  I believe 
HDFS already supports federation, and YARN federation work is underway.

Daniel

On 2/15/17 11:15 PM, Dave Morris wrote:
> Hi everyone,
>
> I am confronted with quite a difficult problem, how to connect 2 separate
> Hadoop instances, each having their own HDFS's, HBASE's etc.
>
> My first though would be what if they share a Master node, surely this will
> allow any Mapreduce or Spark request to be run against both instances?
> Comments?
>
> If the above idea is feasible, how would one ensure that the data
> collection remain in each respective instance, and not be distributed among
> both instances?
>
> Kind Regards
> Dave
>


---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@hadoop.apache.org
For additional commands, e-mail: general-help@hadoop.apache.org


Mime
View raw message