hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Hadoop on IPv6
Date Mon, 09 Sep 2013 20:55:25 GMT
For Hadoop JVMs, generally speaking, need to have the following in
your hadoop-env.sh for HADOOP_OPTS:

export HADOOP_OPTS="-Djava.net.preferIPv4Stack=true $HADOOP_OPTS"

We also ship with this pre-added in the default configs of more recent releases.

You may also need these on other JVM based daemons' opts, such as
HBASE_OPTS/etc. depending on what all you run.

On Tue, Sep 10, 2013 at 2:05 AM, Aji Janis <aji1705@gmail.com> wrote:
> Adam,
> Thank you for the suggestion. Could you point me to any documentation that
> can help with the configuration changes I need to make? Thanks.
> Aji
> On Mon, Sep 9, 2013 at 1:30 PM, Adam Muise <amuise@hortonworks.com> wrote:
>> Keep the Hadoop cluster and it's network backbone on IPv4. It should be
>> isolated from the rest of your network for security and performance reasons
>> already anyway.
>> Enable IPv6 on your gateway nodes and let clients jump in for access via
>> the ipv6 network and use the cluster via ipv4 on the gateway node. You could
>> even setup a web proxy for some of the required sites using nginx or your
>> favorite proxy server. Leave the ipv6 conversion of the Hadoop cluster until
>> it is fully supported and well-tested.
>> On Mon, Sep 9, 2013 at 1:19 PM, Aji Janis <aji1705@gmail.com> wrote:
>>> We are moving to a IPv6 network. I know Hadoop installation says to
>>> disable IPv6. Does anyone have any suggestions for work arround? Currently,
>>> using Cloudera version 0.20.2-cdh3u5. Thanks in advance.
>> --
>> Adam Muise
>> Solution Engineer
>> Hortonworks
>> amuise@hortonworks.com
>> 416-417-4037
>> Hortonworks - Develops, Distributes and Supports Enterprise Apache Hadoop.
>> Hortonworks Virtual Sandbox
>> Hadoop: Disruptive Possibilities by Jeff Needham
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader of
>> this message is not the intended recipient, you are hereby notified that any
>> printing, copying, dissemination, distribution, disclosure or forwarding of
>> this communication is strictly prohibited. If you have received this
>> communication in error, please contact the sender immediately and delete it
>> from your system. Thank You.

Harsh J

View raw message