hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Azuryy Yu <azury...@gmail.com>
Subject Re: Multiple separate Hadoop clusters on same physical machines
Date Mon, 26 Jan 2015 09:34:15 GMT
Hi,

I think the best way is deploy HDFS federation with Hadoop 2.x.

On Mon, Jan 26, 2015 at 5:18 PM, Harun Reşit Zafer <
harun.zafer@tubitak.gov.tr> wrote:

> Hi everyone,
>
> We have set up and been playing with Hadoop 1.2.x and its friends (Hbase,
> pig, hive etc.) on 7 physical servers. We want to test Hadoop (maybe
> different versions) and ecosystem on physical machines (virtualization is
> not an option) from different perspectives.
>
> As a bunch of developer we would like to work in parallel. We want every
> team member play with his/her own cluster. However we have limited amount
> of servers (strong machines though).
>
> So the question is, by changing port numbers, environment variables and
> other configuration parameters, is it possible to setup several independent
> clusters on same physical machines. Is there any constraints? What are the
> possible difficulties we are to face?
>
> Thanks in advance
>
> --
> Harun Reşit Zafer
> TÜBİTAK BİLGEM BTE
> Bulut Bilişim ve Büyük Veri Analiz Sistemleri Bölümü
> T +90 262 675 3268
> W  http://www.hrzafer.com
>
>

Mime
View raw message