hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rob Vesse (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5328) MiniDFSCluster times out at startup
Date Thu, 10 Dec 2015 17:01:11 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Rob Vesse updated HDFS-5328:
    Attachment: HDFS-5328.001.patch

Add a patch which makes the startup timeout configurable both via the deprecated constructors
and via the {{MiniDFSCluster.Builder}} with a new {{startupTimeoutSeconds()}} method

Default is left at 10 seconds for the time being

> MiniDFSCluster times out at startup
> -----------------------------------
>                 Key: HDFS-5328
>                 URL: https://issues.apache.org/jira/browse/HDFS-5328
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 2.1.1-beta
>            Reporter: Alejandro Abdelnur
>         Attachments: HDFS-5328.001.patch
> It seems MiniDFSCluster startup got slower lately and we are observing the following
intermittent failure on startup in our jenkins boxes:
> {code}
> java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:972)
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:665)
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:585)
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:511)
> {code}
> By looking at the code the {{waitClusterUp()}} has a hardcoded 10secs timeout (10 1 sec
> There are two things we should look at it, make the timeout configurable, and more important,
see what has changed to make the startup slower.

This message was sent by Atlassian JIRA

View raw message