hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14814) HDFS UI port clashes cause test fails
Date Sun, 15 Nov 2015 00:57:10 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005690#comment-15005690
] 

stack commented on HBASE-14814:
-------------------------------

Here is how it looks on fail:

{code}
Error Message

Port in use: localhost:0
Stacktrace

java.net.BindException: Port in use: localhost:0
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
	at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:885)
	at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:826)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:693)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:583)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:751)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:735)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1407)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:998)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:869)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:704)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:642)
	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:577)
	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:533)
	at org.apache.hadoop.hbase.util.TestFSUtils.testIsHDFS(TestFSUtils.java:111)
{code}


Here is rest of log:

{code}
015-11-14 21:09:09,080 ERROR [main] hdfs.MiniDFSCluster(709): IOE creating namenodes. Permissions
dump:
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs/data':

	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs/data
	permissions: ----
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs':

	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc/dfs
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc':

	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b/dfscluster_85511ee0-65cc-4850-8b87-6ecf97f1cffc
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b':

	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data/c54ebf05-cbf8-40e6-a25e-213289f6d51b
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data':

	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target/test-data
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target':

	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server/target
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server':

	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop/hbase-server
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop': 
	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label/Hadoop
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label': 
	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8/label
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8': 
	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk/latest1.8
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk': 
	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2/jdk
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace/HBase-1.2': 
	absolute:/home/jenkins/jenkins-slave/workspace/HBase-1.2
	permissions: drwx
path '/home/jenkins/jenkins-slave/workspace': 
	absolute:/home/jenkins/jenkins-slave/workspace
	permissions: drwx
path '/home/jenkins/jenkins-slave': 
	absolute:/home/jenkins/jenkins-slave
	permissions: drwx
path '/home/jenkins': 
	absolute:/home/jenkins
	permissions: drwx
path '/home': 
	absolute:/home
	permissions: dr-x
path '/': 
	absolute:/
	permissions: dr-x
{code}

It caused 76 tests to fail in a 1.2 run:

{code}
Test Result (76 failures / +76)
org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster.testOveralyOnOtherCluster
org.apache.hadoop.hbase.TestMetaTableAccessor.org.apache.hadoop.hbase.TestMetaTableAccessor
org.apache.hadoop.hbase.TestNamespace.org.apache.hadoop.hbase.TestNamespace
TEST-org.apache.hadoop.hbase.TestZooKeeper.xml.<init>
org.apache.hadoop.hbase.client.TestAdmin2.org.apache.hadoop.hbase.client.TestAdmin2
org.apache.hadoop.hbase.client.TestCheckAndMutate.org.apache.hadoop.hbase.client.TestCheckAndMutate
org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout
org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient.org.apache.hadoop.hbase.client.TestCloneSnapshotFromClient
org.apache.hadoop.hbase.client.TestCloneSnapshotFromClientWithRegionReplicas.org.apache.hadoop.hbase.client.TestCloneSnapshotFromClientWithRegionReplicas
org.apache.hadoop.hbase.client.TestFromClientSide.org.apache.hadoop.hbase.client.TestFromClientSide
org.apache.hadoop.hbase.client.TestFromClientSide3.org.apache.hadoop.hbase.client.TestFromClientSide3
org.apache.hadoop.hbase.client.TestFromClientSideNoCodec.org.apache.hadoop.hbase.client.TestFromClientSideNoCodec
org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor.org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor
org.apache.hadoop.hbase.client.TestHCM.org.apache.hadoop.hbase.client.TestHCM
org.apache.hadoop.hbase.client.TestHTableMultiplexer.org.apache.hadoop.hbase.client.TestHTableMultiplexer
org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool.org.apache.hadoop.hbase.client.TestHTablePool$TestHTableReusablePool
org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool.org.apache.hadoop.hbase.client.TestHTablePool$TestHTableThreadLocalPool
org.apache.hadoop.hbase.client.TestMetaScanner.testConcurrentMetaScannerAndCatalogJanitor
org.apache.hadoop.hbase.client.TestMetaScanner.testMetaScanner
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithFewerMetaReplicaZnodes
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testShutdownHandling
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testMetaHTDReplicaCount
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testChangingReplicaCount
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testMetaAddressChange
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithMetaReplicas
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithExcessMetaReplicas
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testHBaseFsckWithFewerMetaReplicas
org.apache.hadoop.hbase.client.TestMetaWithReplicas.testMetaLookupThreadPoolCreated
org.apache.hadoop.hbase.client.TestPutWithDelete.org.apache.hadoop.hbase.client.TestPutWithDelete
TEST-org.apache.hadoop.hbase.client.TestReplicaWithCluster.xml.<init>
org.apache.hadoop.hbase.client.TestReplicasClient.org.apache.hadoop.hbase.client.TestReplicasClient
org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient.org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClient
org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas.org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas
org.apache.hadoop.hbase.client.TestRpcControllerFactory.org.apache.hadoop.hbase.client.TestRpcControllerFactory
org.apache.hadoop.hbase.client.TestScannerTimeout.org.apache.hadoop.hbase.client.TestScannerTimeout
org.apache.hadoop.hbase.client.TestScannersFromClientSide.org.apache.hadoop.hbase.client.TestScannersFromClientSide
org.apache.hadoop.hbase.client.TestSnapshotFromClient.org.apache.hadoop.hbase.client.TestSnapshotFromClient
org.apache.hadoop.hbase.client.TestSnapshotFromClientWithRegionReplicas.org.apache.hadoop.hbase.client.TestSnapshotFromClientWithRegionReplicas
org.apache.hadoop.hbase.client.TestSnapshotMetadata.org.apache.hadoop.hbase.client.TestSnapshotMetadata
org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithMultiRegion
org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithSingleRegion
org.apache.hadoop.hbase.client.TestTableSnapshotScanner.testWithOfflineHBaseMultiRegion
org.apache.hadoop.hbase.client.TestTimestampsFilter.org.apache.hadoop.hbase.client.TestTimestampsFilter
org.apache.hadoop.hbase.client.replication.TestReplicationAdminWithClusters.org.apache.hadoop.hbase.client.replication.TestReplicationAdminWithClusters
org.apache.hadoop.hbase.filter.TestFilterWithScanLimits.org.apache.hadoop.hbase.filter.TestFilterWithScanLimits
org.apache.hadoop.hbase.filter.TestFuzzyRowAndColumnRangeFilter.org.apache.hadoop.hbase.filter.TestFuzzyRowAndColumnRangeFilter
org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd.org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd
org.apache.hadoop.hbase.io.TestFileLink.testHDFSLinkReadDuringDelete
org.apache.hadoop.hbase.io.TestFileLink.testHDFSLinkReadDuringRename
org.apache.hadoop.hbase.util.TestConnectionCache.testConnectionChore
org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy.org.apache.hadoop.hbase.util.TestCoprocessorScanPolicy
org.apache.hadoop.hbase.util.TestFSUtils.testcomputeHDFSBlocksDistribution
org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyValidButMaybeNotPresent
org.apache.hadoop.hbase.util.TestFSUtils.testIsHDFS
org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyDefault
org.apache.hadoop.hbase.util.TestFSUtils.testSetStoragePolicyInvalid
org.apache.hadoop.hbase.util.TestMergeTool.testMergeTool
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[0]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[1]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[2]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[3]
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded.loadTest[4]
org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel.loadTest[2]
org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel.loadTest[3]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[0]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[1]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[2]
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential.loadTest[3]
org.apache.hadoop.hbase.util.TestRegionSplitter.org.apache.hadoop.hbase.util.TestRegionSplitter
org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildBase.testMetaRebuild
org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap.testMetaRebuildOverlapFail
org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingProvider.org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingProvider
org.apache.hadoop.hbase.wal.TestDefaultWALProvider.org.apache.hadoop.hbase.wal.TestDefaultWALProvider
org.apache.hadoop.hbase.wal.TestDefaultWALProviderWithHLogKey.org.apache.hadoop.hbase.wal.TestDefaultWALProviderWithHLogKey
org.apache.hadoop.hbase.wal.TestWALFactory.org.apache.hadoop.hbase.wal.TestWALFactory
org.apache.hadoop.hbase.wal.TestWALFiltering.testFlushedSequenceIdsSentToHMaster

{code}

Here....https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.2/370/#showFailuresLink

I could try and choose random ports for UI if not done already to make this happen less often.

> HDFS UI port clashes cause test fails
> -------------------------------------
>
>                 Key: HBASE-14814
>                 URL: https://issues.apache.org/jira/browse/HBASE-14814
>             Project: HBase
>          Issue Type: Sub-task
>          Components: flakey, test
>            Reporter: stack
>            Assignee: stack
>
> In test runs, HDFS UI can clash when concurrent test runs.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message