hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sri ram <rsriram...@gmail.com>
Subject Re: Error while starting datanode in hadoop 0.23 in secure mode
Date Tue, 13 Dec 2011 12:00:14 GMT
Both master and master.example.com points to the current local address.
Namenode is running well.

On Tue, Dec 13, 2011 at 4:57 PM, alo alt <wget.null@googlemail.com> wrote:

> Hi,
>
> master.example.com? I don't think that a NN is running there ;)
> And "master" are available in DNS?
>
> The config looks misconfigured, you have to setup a working environment.
>
> - Alex
>
>
> On Tue, Dec 13, 2011 at 12:02 PM, sri ram <rsriramtce@gmail.com> wrote:
> > The following is the content of mapred-site.xml
> > <?xml version="1.0"?>
> > <?xml-stylesheet href="configuration.xsl"?>
> > <configuration>
> > <property>
> > <name>dfs.replication</name>
> > <value>1</value>
> > </property>
> > <property>
> > <name>dfs.permissions</name>
> > <value>false</value>
> > </property>
> > <property>
> > <name>dfs.namenode.name.dir</name>
> > <value>/app/tmp/name</value>
> > </property>
> > <property>
> > <name>dfs.datanode.data.dir</name>
> > <value>/app/tmp/data</value>
> > </property>
> > <!--kerberos-->
> > <!--NAMENODE CONF-->
> > <property>
> > <name>dfs.block.access.token.enable</name>
> > <value>true</value>
> > </property>
> > <property>
> > <name>dfs.https.enable</name>
> > <value>true</value>
> > </property>
> > <property>
> > <name>dfs.namenode.https-address</name>
> > <value>master.example.com:50470</value>
> > </property>
> > <property>
> > <name>dfs.https.port</name>
> > <value>50470</value>
> > </property>
> > <property>
> > <name>dfs.namenode.keytab.file</name>
> > <value>/etc/security/keytab/nn.service.keytab</value>
> > </property>
> > <property>
> > <name>dfs.namenode.kerberos.principal</name>
> > <value>nn/master.example.com@EXAMPLE.COM</value>
> > </property>
> > <property>
> > <name>dfs.namenode.kerberos.https.principal</name>
> > <value>host/master.example.com@EXAMPLE.COM</value>
> > </property>
> > <!--DATANODE CONF-->
> > <property>
> > <name>dfs.datanode.data.dir.perm</name>
> > <value>700</value>
> > </property>
> > <property>
> > <name>dfs.datanode.address</name>
> > <value>master:1003</value>
> > </property>
> >
> > <property>
> > <name>dfs.datanode.https.address</name>
> > <value>master:1005</value>
> > </property>
> > <property>
> > <name>dfs.datanode.http.address</name>
> > <value>master:1006</value>
> > </property>
> >
> > <property>
> > <name>dfs.datanode.keytab.file</name>
> > <value>/etc/security/keytab/dn.service.keytab</value>
> > </property>
> > <property>
> > <name>dfs.datanode.kerberos.principal</name>
> > <value>dn/master.example.com@EXAMPLE.COM</value>
> > </property>
> > <property>
> > <name>dfs.datanode.kerberos.https.principal</name>
> > <value>host/master.example.com@EXAMPLE.COM</value>
> > </property>
> >
> > </configuration>
> >
> > The following is the error log while starting datanode as root
> > 2011-12-13 16:19:26,837 INFO  datanode.DataNode
> > (StringUtils.java:startupShutdownMessage(589)) - STARTUP_MSG:
> > /************************************************************
> > STARTUP_MSG: Starting DataNode
> > STARTUP_MSG:   host = master.example.com/147.128.152.179
> > STARTUP_MSG:   args = []
> > STARTUP_MSG:   version = 0.23.0
> > STARTUP_MSG:   classpath =
> >
> /usr/local/hadoop/conf:/usr/local/hadoop/libexec/../share/hadoop/common/lib/activation-1.1.jar:/usr/local/hadoop/libexec/../share$
> > STARTUP_MSG:   build =
> > git://
> devadm900.cc1.ygridcore.net/grid/0/dev/acm/hadoop-trunk/hadoop-common-project/hadoop-common
> > -r d4fee83ec1462ab9824add6449320617$
> > ************************************************************/
> > 2011-12-13 16:19:26,921 WARN  common.Util (Util.java:stringAsURI(63)) -
> Path
> > /app/tmp/data should be specified as a URI in configuration files. Please
> > updat$
> > 2011-12-13 16:19:27,314 INFO  security.UserGroupInformation
> > (UserGroupInformation.java:loginUserFromKeytab(633)) - Login successful
> for
> > user dn/master.examp$
> > 2011-12-13 16:19:27,454 WARN  impl.MetricsConfig
> > (MetricsConfig.java:loadFirst(125)) - Cannot locate configuration: tried
> > hadoop-metrics2-datanode.propertie$
> > 2011-12-13 16:19:27,548 INFO  impl.MetricsSystemImpl
> > (MetricsSystemImpl.java:startTimer(343)) - Scheduled snapshot period at
> 10
> > second(s).
> > 2011-12-13 16:19:27,548 INFO  impl.MetricsSystemImpl
> > (MetricsSystemImpl.java:start(182)) - DataNode metrics system started
> > 2011-12-13 16:19:27,549 INFO  impl.MetricsSystemImpl
> > (MetricsSystemImpl.java:registerSource(244)) - Registered source
> UgiMetrics
> > 2011-12-13 16:19:27,572 INFO  datanode.DataNode
> > (DataNode.java:initDataXceiver(701)) - Opened info server at 1003
> > 2011-12-13 16:19:27,585 INFO  datanode.DataNode
> > (DataXceiverServer.java:<init>(77)) - Balancing bandwith is 1048576
> bytes/s
> > 2011-12-13 16:19:27,617 INFO  mortbay.log (Slf4jLog.java:info(67)) -
> Logging
> > to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> > org.mortbay.log.Slf4j$
> > 2011-12-13 16:19:27,703 INFO  http.HttpServer
> > (HttpServer.java:addGlobalFilter(476)) - Added global filter 'safety'
> > (class=org.apache.hadoop.http.HttpServer$
> > 2011-12-13 16:19:27,706 WARN  lib.StaticUserWebFilter
> > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi should
> not
> > be used. Instead, use had$
> > 2011-12-13 16:19:27,707 INFO  http.HttpServer
> > (HttpServer.java:addFilter(454)) - Added filter static_user_filter
> > (class=org.apache.hadoop.http.lib.StaticUse$
> > 2011-12-13 16:19:27,707 INFO  http.HttpServer
> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter
> > (class=org.apache.hadoop.http.lib.StaticUse$
> > 2011-12-13 16:19:27,708 INFO  http.HttpServer
> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter
> > (class=org.apache.hadoop.http.lib.StaticUse$
> > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-13 16:19:27,732 INFO
> > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
> > 2011-12-13 16:19:28,096 INFO  mortbay.log (Slf4jLog.java:info(67)) -
> Started
> > SelectChannelConnector@master:1006
> > 2011-12-13 16:19:28,100 WARN  mortbay.log (Slf4jLog.java:warn(76)) -
> > java.lang.NullPointerException
> > 2011-12-13 16:19:28,101 WARN  mortbay.log (Slf4jLog.java:warn(76)) -
> failed
> > Krb5AndCertsSslSocketConnector@master:1005: java.io.IOException:
> > !JsseListener: $
> > 2011-12-13 16:19:28,101 WARN  mortbay.log (Slf4jLog.java:warn(76)) -
> failed
> > Server@179d854: java.io.IOException: !JsseListener:
> > java.lang.NullPointerExcepti$
> > 2011-12-13 16:19:28,104 INFO  mortbay.log (Slf4jLog.java:info(67)) -
> Stopped
> > Krb5AndCertsSslSocketConnector@master:1005
> > 2011-12-13 16:19:28,104 INFO  mortbay.log (Slf4jLog.java:info(67)) -
> Stopped
> > SelectChannelConnector@master:1006
> > 2011-12-13 16:19:28,107 INFO  datanode.DataNode
> > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to exit, active
> > threads is 0
> > 2011-12-13 16:19:28,108 ERROR datanode.DataNode
> > (DataNode.java:secureMain(2371)) - Exception in secureMain
> >
> > java.io.IOException: !JsseListener: java.lang.NullPointerException
> >         at
> >
> org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516)
> >         at
> >
> org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123)
> >         at
> > org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73)
> >         at
> > org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283)
> >         at
> > org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147)
> >
> > at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> >         at org.mortbay.jetty.Server.doStart(Server.java:235)
> >         at
> > org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> >         at org.apache.hadoop.http.HttpServer.start(HttpServer.java:639)
> >         at
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:575)
> >         at
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1501)
> >         at
> > org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:457)
> >         at
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2263)
> >         at
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2196)
> >         at
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2219)
> >         at
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2367)
> >         at
> >
> org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.start(SecureDataNodeStarter.java:108)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >         at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:616)
> >         at
> >
> org.apache.commons.daemon.support.DaemonLoader.start(DaemonLoader.java:188)
> > 2011-12-13 16:19:28,111 INFO  datanode.DataNode
> (StringUtils.java:run(605))
> > - SHUTDOWN_MSG:
> > /************************************************************
> > SHUTDOWN_MSG: Shutting down DataNode at
> master.example.com/147.128.152.179
> >
> >
> >
> > On Tue, Dec 13, 2011 at 4:23 PM, sri ram <rsriramtce@gmail.com> wrote:
> >>
> >> telnet master ip says "unable to connect to remote host.
> >> This is my following property for datanode in secure mode
> >> <property>
> >> <name>dfs.datanode.https.address</name>
> >> <value>master:1005</value>
> >> </property>
> >>
> >>
> >>
> >> On Tue, Dec 13, 2011 at 4:18 PM, alo alt <wget.null@googlemail.com>
> wrote:
> >>>
> >>> Check if kerberos respond:
> >>>
> >>> telnet KERBEROS_IP 1005
> >>>
> >>> As I know use kerberos per default ports 88, AFS token 746 (4444),
> kx509
> >>> 9878
> >>>
> >>> - Alex
> >>>
> >>>
> >>> On Tue, Dec 13, 2011 at 11:39 AM, sri ram <rsriramtce@gmail.com>
> wrote:
> >>> > Thanks for the reply,
> >>> >                I have tried with the ip of the individual systems
> >>> > also.But
> >>> > the same eroor reoccurs
> >>> >
> >>> >
> >>> > On Tue, Dec 13, 2011 at 3:40 PM, alo alt <wget.null@googlemail.com>
> >>> > wrote:
> >>> >>
> >>> >> Hi,
> >>> >>
> >>> >> 2011-12-14 14:35:54,047 WARN  mortbay.log (Slf4jLog.java:warn(76))
-
> >>> >> failed Krb5AndCertsSslSocketConnector@0.0.0.0:1005:
> >>> >> java.io.IOException: !JsseListener:$
> >>> >> 2011-12-14 14:35:54,048 WARN  mortbay.log (Slf4jLog.java:warn(76))
-
> >>> >> failed Server@1867df9: java.io.IOException: !JsseListener:
> >>> >> java.lang.NullPointerExcepti$
> >>> >> 2011-12-14 14:35:54,085 INFO  mortbay.log (Slf4jLog.java:info(67))
-
> >>> >> Stopped Krb5AndCertsSslSocketConnector@0.0.0.0:1005
> >>> >>
> >>> >> 0.0.0.0 as Kerberos - IP can't work.
> >>> >>
> >>> >> - Alex
> >>> >>
> >>> >> On Tue, Dec 13, 2011 at 10:27 AM, sri ram <rsriramtce@gmail.com>
> >>> >> wrote:
> >>> >> > Hi,
> >>> >> >          I receive the following error while starting datanode
in
> >>> >> > secure
> >>> >> > mode of hadoop 0.23
> >>> >> >
> >>> >> > 2011-12-14 14:35:48,468 INFO  http.HttpServer
> >>> >> > (HttpServer.java:addGlobalFilter(476)) - Added global filter
> >>> >> > 'safety'
> >>> >> > (class=org.apache.hadoop.http.HttpServer$
> >>> >> > 2011-12-14 14:35:48,471 WARN  lib.StaticUserWebFilter
> >>> >> > (StaticUserWebFilter.java:getUsernameFromConf(141)) - dfs.web.ugi
> >>> >> > should
> >>> >> > not
> >>> >> > be used. Instead, use had$
> >>> >> > 2011-12-14 14:35:48,472 INFO  http.HttpServer
> >>> >> > (HttpServer.java:addFilter(454)) - Added filter static_user_filter
> >>> >> > (class=org.apache.hadoop.http.lib.StaticUse$
> >>> >> > 2011-12-14 14:35:48,472 INFO  http.HttpServer
> >>> >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter
> >>> >> > (class=org.apache.hadoop.http.lib.StaticUse$
> >>> >> > 2011-12-14 14:35:48,473 INFO  http.HttpServer
> >>> >> > (HttpServer.java:addFilter(461)) - Added filter static_user_filter
> >>> >> > (class=org.apache.hadoop.http.lib.StaticUse$
> >>> >> > jetty.ssl.password : jetty.ssl.keypassword : 2011-12-14
> 14:35:53,553
> >>> >> > INFO
> >>> >> > mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
> >>> >> > 2011-12-14 14:35:54,044 INFO  mortbay.log
> (Slf4jLog.java:info(67)) -
> >>> >> > Started
> >>> >> > SelectChannelConnector@master:1006
> >>> >> > 2011-12-14 14:35:54,047 WARN  mortbay.log
> (Slf4jLog.java:warn(76)) -
> >>> >> > java.lang.NullPointerException
> >>> >> > 2011-12-14 14:35:54,047 WARN  mortbay.log
> (Slf4jLog.java:warn(76)) -
> >>> >> > failed
> >>> >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005: java.io.IOException:
> >>> >> > !JsseListener:$
> >>> >> > 2011-12-14 14:35:54,048 WARN  mortbay.log
> (Slf4jLog.java:warn(76)) -
> >>> >> > failed
> >>> >> > Server@1867df9: java.io.IOException: !JsseListener:
> >>> >> > java.lang.NullPointerExcepti$
> >>> >> > 2011-12-14 14:35:54,085 INFO  mortbay.log
> (Slf4jLog.java:info(67)) -
> >>> >> > Stopped
> >>> >> > Krb5AndCertsSslSocketConnector@0.0.0.0:1005
> >>> >> > 2011-12-14 14:35:54,085 INFO  mortbay.log
> (Slf4jLog.java:info(67)) -
> >>> >> > Stopped
> >>> >> > SelectChannelConnector@master:1006
> >>> >> > 2011-12-14 14:35:54,189 INFO  datanode.DataNode
> >>> >> > (DataNode.java:shutdown(1741)) - Waiting for threadgroup to
exit,
> >>> >> > active
> >>> >> > threads is 0
> >>> >> > 2011-12-14 14:35:54,190 ERROR datanode.DataNode
> >>> >> > (DataNode.java:secureMain(2371)) - Exception in secureMain
> >>> >> > java.io.IOException: !JsseListener: java.lang.NullPointerException
> >>> >> >         at
> >>> >> >
> >>> >> >
> >>> >> >
> org.mortbay.jetty.security.SslSocketConnector.newServerSocket(SslSocketConnector.java:516)
> >>> >> >         at
> >>> >> >
> >>> >> >
> >>> >> >
> org.apache.hadoop.security.Krb5AndCertsSslSocketConnector.newServerSocket(Krb5AndCertsSslSocketConnector.java:123)
> >>> >> >         at
> >>> >> >
> org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73)
> >>> >> >         at
> >>> >> >
> >>> >> >
> org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283)
> >>> >> >         at
> >>> >> >
> >>> >> >
> org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147)
> >>> >> >
> >>> >> > Is there any way to resolve this???
> >>> >> >
> >>> >>
> >>> >>
> >>> >>
> >>> >> --
> >>> >> Alexander Lorenz
> >>> >> http://mapredit.blogspot.com
> >>> >>
> >>> >> P Think of the environment: please don't print this email unless
you
> >>> >> really need to.
> >>> >
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> Alexander Lorenz
> >>> http://mapredit.blogspot.com
> >>>
> >>> P Think of the environment: please don't print this email unless you
> >>> really need to.
> >>
> >>
> >
>
>
>
> --
> Alexander Lorenz
> http://mapredit.blogspot.com
>
> P Think of the environment: please don't print this email unless you
> really need to.
>

Mime
View raw message