hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ajay Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12559) Ozone: TestContainerPersistence#testListContainer sometimes timeout
Date Wed, 27 Sep 2017 20:39:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ajay Kumar updated HDFS-12559:
------------------------------
    Description: 
This test creates 1000 containers and reads them back 5 containers at a time and verifies
that we did get back all containers. On my laptop, it takes 11s to finish but on some slow
Jenkins machine this could take longer time. 

Current the whole test suite {{TestContainerPersistence}} has a timeout rule of  5 min. Need
to understand  why RocksDB open is taking such a long time as shown in the stack below.

{code}
java.lang.Exception: test timed out after 300000 milliseconds
	at org.rocksdb.RocksDB.open(Native Method)
	at org.rocksdb.RocksDB.open(RocksDB.java:231)
	at org.apache.hadoop.utils.RocksDBStore.<init>(RocksDBStore.java:64)
	at org.apache.hadoop.utils.MetadataStoreBuilder.build(MetadataStoreBuilder.java:94)
	at org.apache.hadoop.ozone.container.common.helpers.ContainerUtils.createMetadata(ContainerUtils.java:254)
	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.writeContainerInfo(ContainerManagerImpl.java:396)
	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.createContainer(ContainerManagerImpl.java:329)
	at org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.testListContainer(TestContainerPersistence.java:341)
{code}

  was:
his test creates 1000 containers and reads them back 5 containers at a time and verifies that
we did get back all containers. On my laptop, it takes 11s to finish but on some slow Jenkins
machine this could take longer time. 

Current the whole test suite {{TestContainerPersistence}} has a timeout rule of  5 min. Need
to understand  why RocksDB open is taking such a long time as shown in the stack below.

{code}
java.lang.Exception: test timed out after 300000 milliseconds
	at org.rocksdb.RocksDB.open(Native Method)
	at org.rocksdb.RocksDB.open(RocksDB.java:231)
	at org.apache.hadoop.utils.RocksDBStore.<init>(RocksDBStore.java:64)
	at org.apache.hadoop.utils.MetadataStoreBuilder.build(MetadataStoreBuilder.java:94)
	at org.apache.hadoop.ozone.container.common.helpers.ContainerUtils.createMetadata(ContainerUtils.java:254)
	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.writeContainerInfo(ContainerManagerImpl.java:396)
	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.createContainer(ContainerManagerImpl.java:329)
	at org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.testListContainer(TestContainerPersistence.java:341)
{code}


> Ozone: TestContainerPersistence#testListContainer sometimes timeout
> -------------------------------------------------------------------
>
>                 Key: HDFS-12559
>                 URL: https://issues.apache.org/jira/browse/HDFS-12559
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Xiaoyu Yao
>            Assignee: Ajay Kumar
>
> This test creates 1000 containers and reads them back 5 containers at a time and verifies
that we did get back all containers. On my laptop, it takes 11s to finish but on some slow
Jenkins machine this could take longer time. 
> Current the whole test suite {{TestContainerPersistence}} has a timeout rule of  5 min.
Need to understand  why RocksDB open is taking such a long time as shown in the stack below.
> {code}
> java.lang.Exception: test timed out after 300000 milliseconds
> 	at org.rocksdb.RocksDB.open(Native Method)
> 	at org.rocksdb.RocksDB.open(RocksDB.java:231)
> 	at org.apache.hadoop.utils.RocksDBStore.<init>(RocksDBStore.java:64)
> 	at org.apache.hadoop.utils.MetadataStoreBuilder.build(MetadataStoreBuilder.java:94)
> 	at org.apache.hadoop.ozone.container.common.helpers.ContainerUtils.createMetadata(ContainerUtils.java:254)
> 	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.writeContainerInfo(ContainerManagerImpl.java:396)
> 	at org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.createContainer(ContainerManagerImpl.java:329)
> 	at org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.testListContainer(TestContainerPersistence.java:341)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message