hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gokul Prasad <nhgokulpra...@gmail.com>
Subject Re: hadoop high availability using terracotta
Date Fri, 23 Sep 2011 19:05:33 GMT

Am planning to implement this idea in bigger cluster but first i want
to get confidence in small cluster. I do read about terracotta and
inspired by this idea.


On Fri, Sep 23, 2011 at 11:57 PM, Konstantin Boudnik <cos@apache.org> wrote:
> Gokul,
> Terracotta is a fascinating framework which might be a bit of an overshot for a
> small setup as well as adding another level of complexity in the form
> Terracotta framework.
> Quite interesting approach for NN's HA is Jini (aka ASF River) along with
> JavaSpaces for the distributed storage of the meta-data. Using Jini also gives
> you for free such benefits as auto-discovering making hot-swap of NN a non-issue.
> I've been musing over this idea for some time and am trying to find some time
> to actually experiment with it.
> Cos
> On Fri, Sep 23, 2011 at 11:36PM, Gokul Prasad wrote:
>>    Hi,
>>    Am trying to bring high availability in namenode(in hadoop cluster) for
>>    small setup.
>>    So the idea is to keep one extra namenode and use terracotta to replicate
>>    the log(in memory details-jvm) from primary datacode to standby namenode,
>>    if primary goes down secondary can take the primary role.
>>    Now am bit confused how to start second namenode while the primary name
>>    node up and running(with datanode connected) with keep relying the info
>>    from primary thro terracotta. Is there a way to achieve this without
>>    restarting namenode or datanode, any patch?
>>    Please help and suggest me.
>>    Regards,
>>    Gokul

View raw message