hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: nodemanager listen on 0.0.0.0
Date Wed, 09 Dec 2015 05:54:32 GMT
Thank you Varun, https://issues.apache.org/jira/browse/MAPREDUCE-5938 is
the one.

On Tue, Dec 8, 2015 at 10:02 PM Varun Saxena <vsaxena.varun@gmail.com>
wrote:

> There is already a JIRA for it - MAPREDUCE-5938(and other related JIRAs'
> MAPREDUCE-6402 and YARN-4119)
>
> Regards,
> Varun Saxena
>
> On Tue, Dec 8, 2015 at 9:56 PM, Harsh J <harsh@cloudera.com> wrote:
>
>> Hello,
>>
>> Could you file a JIRA for this please? Currently the ShuffleHandler will
>> always bind to wildcard address due to the code being that way (in both
>> branch-2 and trunk presently:
>> https://github.com/apache/hadoop/blob/release-2.7.1/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java#L388
>> ).
>>
>> Your current workaround would be to use a firewall to drop out external
>> connections to that port.
>>
>> On Tue, Dec 8, 2015 at 9:30 PM Varun Vasudev <vvasudev@apache.org> wrote:
>>
>>> Hi Li,
>>>
>>> What have you set yarn.nodemanager.bind-host to? From
>>> https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-common/yarn-default.xml
>>> -
>>>
>>> "The actual address the server will bind to. If this optional address is
>>>       set, the RPC and webapp servers will bind to this address and the
>>> port specified in
>>>       yarn.nodemanager.address and yarn.nodemanager.webapp.address,
>>> respectively. This is
>>>       most useful for making NM listen to all interfaces by setting to
>>> 0.0.0.0”
>>>
>>> -Varun
>>>
>>>
>>>
>>> On 12/8/15, 2:57 PM, "Li Li" <fancyerii@gmail.com> wrote:
>>>
>>> >   I want to setup a yarn cluster. It's not allowed to visit from
>>> >public network so I changed many configuration files to let all
>>> >service bind to the internal network address.
>>> >   All thing is fine exception the nodemanager which bind
>>> >0.0.0.0:13562. I searched the default-mapred-default.xml and found it
>>> >mapreduce.shuffle.port.
>>> >   Which configuration file should I change to let nodemanager listen
>>> >on internal address instead of 0.0.0.0?
>>> >
>>> >---------------------------------------------------------------------
>>> >To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
>>> >For additional commands, e-mail: user-help@hadoop.apache.org
>>> >
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: user-help@hadoop.apache.org
>>>
>>>
>

Mime
View raw message