hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rob Vesse (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-5328) MiniDFSCluster times out at startup
Date Thu, 10 Dec 2015 17:01:11 GMT

     [ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rob Vesse updated HDFS-5328:
----------------------------
    Attachment: HDFS-5328.001.patch

Add a patch which makes the startup timeout configurable both via the deprecated constructors
and via the {{MiniDFSCluster.Builder}} with a new {{startupTimeoutSeconds()}} method

Default is left at 10 seconds for the time being

> MiniDFSCluster times out at startup
> -----------------------------------
>
>                 Key: HDFS-5328
>                 URL: https://issues.apache.org/jira/browse/HDFS-5328
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 2.1.1-beta
>            Reporter: Alejandro Abdelnur
>         Attachments: HDFS-5328.001.patch
>
>
> It seems MiniDFSCluster startup got slower lately and we are observing the following
intermittent failure on startup in our jenkins boxes:
> {code}
> java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:972)
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:665)
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:585)
> 	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:511)
> {code}
> By looking at the code the {{waitClusterUp()}} has a hardcoded 10secs timeout (10 1 sec
waits).
> There are two things we should look at it, make the timeout configurable, and more important,
see what has changed to make the startup slower.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message