hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kun Ren <ren.h...@gmail.com>
Subject Re: HDFS Federation
Date Sun, 01 May 2016 18:51:50 GMT
Thanks a lot.

On Fri, Apr 29, 2016 at 2:32 PM, Akira AJISAKA <ajisakaa@oss.nttdata.co.jp>
wrote:

> > Do you know where is the 50070 come form or where to set it?
>
> 50070 comes from "dfs.namenode.http-address".
> You can set this in hdfs-site.xml.
>
> > If I configure the Federation in one node, I probably will change this,
> right?
> No. If you configure NameNode federation, you need to set
> "dfs.nameservices" and "dfs.namenode.http-address.<nameservice ID>".
> Please see
> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/Federation.html
> for the detail.
>
> -Akira
>
> On 4/28/16 22:48, Kun Ren wrote:
>
>> Thanks a lot, Akira.
>>
>> When the Federation is disabled, I can view the namenode from
>> http://localhost:50070
>>
>> Do you know where is the 50070 come form or where to set it? If I
>> configure the Federation in one node, I probably will change this, right?
>>
>> Thanks a lot.
>>
>> On Thu, Apr 28, 2016 at 1:55 AM, Akira AJISAKA
>> <ajisakaa@oss.nttdata.co.jp <mailto:ajisakaa@oss.nttdata.co.jp>> wrote:
>>
>>     Hi Kun,
>>
>>     (1) ViewFileSystem is related.
>>
>> https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/ViewFs.html
>>
>>     (2) Yes, NameNode Federation is disabled by default.
>>     I suppose it is possible to configure NameNode Federation in one
>>     node by setting different HTTP/RPC port and fsimage/edits directory
>>     for each NameNode. I haven't tried this, so perhaps it is not
>> possible.
>>
>>     Regards,
>>     Akira
>>
>>     On 4/28/16 09:30, Kun Ren wrote:
>>
>>         Hi Genius,
>>
>>         I have two questions about the HDFS Federation:
>>         (1) Since there are multiple namenodes,  there should be some
>>         code that
>>         analysis the client request and transfer  the request to the
>>         appropriate
>>         namenode, could you please point to me where I can find the
>>         related code?
>>
>>         (2) .Also just confirm that the Hadoop 2.7.2 support HDFS
>>         Federation,
>>         but in default there is only 1 namenode, is this correct?
>>         Meanwhile, do
>>         you think it is possible to configure the HDFS Fderation in the
>>         pseudo
>>         distributed mode in one node?
>>
>>         Thanks so much in advance.
>>
>>         Best,
>>         Kun Ren
>>
>>
>>
>>     ---------------------------------------------------------------------
>>     To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
>>     <mailto:user-unsubscribe@hadoop.apache.org>
>>     For additional commands, e-mail: user-help@hadoop.apache.org
>>     <mailto:user-help@hadoop.apache.org>
>>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: user-help@hadoop.apache.org
>
>

Mime
View raw message