hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rakhi Khatwani <rakhi.khatw...@gmail.com>
Subject Re: Multicluster Communication
Date Fri, 19 Jun 2009 11:04:00 GMT
Hi Harish,

I want both of them 2 b compute clusters. but yea... how wud they hv a
common storage area

we basically want to seperate the collection from analysis. is it possible
to dedicate a set of nodes in the hadoop cluster only for collections and
another set of nodes in the same cluster only for analysis?

Regards
Raakhi

On Fri, Jun 19, 2009 at 4:19 PM, Harish Mallipeddi <
harish.mallipeddi@gmail.com> wrote:

> On Fri, Jun 19, 2009 at 4:06 PM, Rakhi Khatwani <rakhi.khatwani@gmail.com
> >wrote:
>
> >
> > we want hadoop cluster 1 for collecting data n storing it in HDFS
> > we want hadoop cluster 2 for using the stored data from HDFS and
> analysing
> > it.
> >
>
> Why do you want to do this in the first place? It seems like you want
> cluster1 to be a plain HDFS cluster and cluster2 to be a mapred cluster.
> Doing something like that will be disastrous - Hadoop is all about sending
> computation closer to your data. If you don't want that, you need not even
> use hadoop.
>
>
> --
> Harish Mallipeddi
> http://blog.poundbang.in
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message