hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nitin Pawar <nitinpawar...@gmail.com>
Subject Re: Multi-Cluster Setup
Date Thu, 03 Jul 2014 15:09:19 GMT
Nothing is stopping you to implement cluster the way you want.
You can have storage only nodes for your HDFS and do not run tasktrackers
on them.

Start bunch of machines with High RAM and high CPUs but no storage.

Only thing to worry then would be network bandwidth to carry data from hdfs
to tasks and back to hdfs.


On Thu, Jul 3, 2014 at 8:29 PM, fab wol <darkwolli32@gmail.com> wrote:

> hey everyone,
>
> MapR is offering the possibility to acces from one cluster (e.g. a compute
> only cluster without much storage capabilities) another cluster's
> HDFS/MapRFS (see http://doc.mapr.com/display/MapR/mapr-clusters.conf). In
> times of Hadoop-as-a-Service this becomes very interesting. Is this somehow
> possible with the "normal" Hadoop Distributions possible (CDH and HDP, I'm
> looking at you ;- ) ) or with even without this help from those
> distributors? Any Hacks and Tricks or even specific Functions are welcome.
> If this is not possible, has anyone issued this as a Ticket or
> something?`Ticket Number forwarding is also appreciated ...
>
> Cheers
> Wolli
>



-- 
Nitin Pawar

Mime
View raw message