hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9396) Total files and directories on jmx and web UI on standby is uninitialized
Date Wed, 11 Nov 2015 15:56:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000559#comment-15000559
] 

Kihwal Lee commented on HDFS-9396:
----------------------------------

{noformat}
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.TestHFlush
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.082 sec - in org.apache.hadoop.hdfs.TestHFlush
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.543 sec - in org.apache.hadoop.hdfs.server.datanode.TestDataNodeMetrics
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 147.408 sec - in org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.382 sec - in org.apache.hadoop.hdfs.server.namenode.TestDeadDatanode
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.374 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestEditLogTailer
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 127.013 sec <<< FAILURE!
- in org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
testCircularLinkedListWrites(org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes)
 Time elapsed: 126.826 sec  <<< FAILURE!
java.lang.AssertionError: Some writers didn't complete in expected runtime! Current writer
state:[Circular Writer:
	 directory: /test-1
	 target length: 50
	 current item: 1
	 done: false
] expected:<0> but was:<1>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.apache.hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes.testCircularLinkedListWrites(TestSeveralNameNodes.java:90)

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.884 sec - in org.apache.hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache
Tests run: 11, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 1.192 sec - in org.apache.hadoop.hdfs.shortcircuit.TestShortCircuitCache
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.TestEncryptedTransfer
Tests run: 26, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.527 sec - in org.apache.hadoop.hdfs.TestEncryptedTransfer
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed
in 8.0
Running org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.674 sec - in org.apache.hadoop.hdfs.security.TestDelegationTokenForProxyUser
{noformat}

When run on my machine, all failed test cases but {{TestSeveralNameNodes}} pass. This is not
related to the patch and will be addressed in HDFS-9376.

> Total files and directories on jmx and web UI on standby is uninitialized
> -------------------------------------------------------------------------
>
>                 Key: HDFS-9396
>                 URL: https://issues.apache.org/jira/browse/HDFS-9396
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Kihwal Lee
>            Assignee: Kihwal Lee
>            Priority: Blocker
>         Attachments: HDFS-9396.patch, HDFS-9396.v2.patch
>
>
> After HDFS-6763, the quota on the standby namenode is not being updated until it transitions
to active. This causes the jmx and the web ui files and dir count to be uninitialized or unupdated.
In some cases it shows a negative number.
> It is because the legacy way of getting the inode count, which existed since before the
creation of inode table. It relies on the root inode's quota being properly updated.  We can
make it simply return the size of the inode table.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message