accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Minh Duc Nguyen (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ACCUMULO-181) Monitor status page says that "Name Node is Down'
Date Wed, 23 Nov 2011 21:52:41 GMT

     [ https://issues.apache.org/jira/browse/ACCUMULO-181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Minh Duc Nguyen updated ACCUMULO-181:
-------------------------------------

    Attachment: NameNodeIsDown.png

I've attached a screenshot.

In the monitor.log file:

java.lang.RuntimeException:
org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
        at
org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161)
        at
org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:239)
        at
org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:297)
        at
org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:323)
        at
org.apache.accumulo.server.monitor.Monitor$3.run(Monitor.java:452)
        at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:662)
Caused by:
org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
        at
org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:238)
        at
org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:73)
        at
org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151)
        ... 6 more
23 16:00:44,401 [net.SocketNode] INFO :  Caught java.io.EOFException
closing conneciton.


In the monitor.debug.log file:

23 15:59:42,203 [servlets.DefaultServlet] DEBUG:
 org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=pegasus, ac
cess=READ_EXECUTE, inode="/var/tmp/hdfs/.staging":hdfs:supergroup:drwx------
org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=pegasus, access=READ_EXECUTE, inode="/var/tmp/hdfs/.staging":
hdfs:supergroup:drwx------
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
        at
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:57)
        at
org.apache.hadoop.hdfs.DFSClient.getContentSummary(DFSClient.java:1014)
        at
org.apache.hadoop.hdfs.DistributedFileSystem.getContentSummary(DistributedFileSystem.java:261)
        at
org.apache.accumulo.server.monitor.servlets.DefaultServlet.doAccumuloTable(DefaultServlet.java:253)
        at
org.apache.accumulo.server.monitor.servlets.DefaultServlet.pageBody(DefaultServlet.java:193)
        at
org.apache.accumulo.server.monitor.servlets.BasicServlet.doGet(BasicServlet.java:50)
        at
org.apache.accumulo.server.monitor.servlets.DefaultServlet.doGet(DefaultServlet.java:136)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
        at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
        at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
        at org.mortbay.jetty.Server.handle(Server.java:326)
        at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
        at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
        at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
        at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Caused by: org.apache.hadoop.ipc.RemoteException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=pegasus, access=READ_EXECUTE,
inode="/var/tmp/hdfs/.staging":hdfs:supergroup:drwx------
        at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:203)
        at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkSubAccess(FSPermissionChecker.java:172)
        at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:141)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5073)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getContentSummary(FSNamesystem.java:2002)
        at
org.apache.hadoop.hdfs.server.namenode.NameNode.getContentSummary(NameNode.java:893)
        at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1428)

        at org.apache.hadoop.ipc.Client.call(Client.java:1107)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
        at $Proxy0.getContentSummary(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
        at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
        at $Proxy0.getContentSummary(Unknown Source)
        at
org.apache.hadoop.hdfs.DFSClient.getContentSummary(DFSClient.java:1012)
        ... 18 more

23 15:59:42,510 [impl.ScannerIterator] DEBUG:
 org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
        at
org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:238)
        at
org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:73)
        at
org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151)
        at
org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:239)
        at
org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:297)
        at
org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:323)
        at
org.apache.accumulo.server.monitor.Monitor$3.run(Monitor.java:452)
        at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:662)
23 15:59:42,511 [monitor.Monitor] INFO :  Failed to obtain problem reports
java.lang.RuntimeException:
org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
        at
org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161)
        at
org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:239)
        at
org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:297)
        at
org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:323)
        at
org.apache.accumulo.server.monitor.Monitor$3.run(Monitor.java:452)
        at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:662)
Caused by:
org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
        at
org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:238)
        at
org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:73)
        at
org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151)
        ... 6 more




On Wed, Nov 23, 2011 at 3:57 PM, Eric Newton (Commented) (JIRA) <


                
> Monitor status page says that "Name Node is Down'
> -------------------------------------------------
>
>                 Key: ACCUMULO-181
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-181
>             Project: Accumulo
>          Issue Type: Bug
>          Components: monitor
>    Affects Versions: 1.3.5, 1.4.0
>         Environment: CentOS release 5.6
> single node Accumulo setup
>            Reporter: Minh Duc Nguyen
>            Assignee: Eric Newton
>            Priority: Trivial
>         Attachments: NameNodeIsDown.png
>
>
> The Accumulo monitor/status page (http://localhost:50095) says that the "Name Node is
Down" (in a red background), but is displaying the correct capacity, % used, and # of corrupt
blocks.    NameNode is up as confirmed by http://localhost:50070/dfshealth.jsp

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message