hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lohit vijayarenu (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3348) TestUrlStreamHandler hangs on LINUX
Date Tue, 06 May 2008 08:45:56 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594521#action_12594521
] 

lohit vijayarenu commented on HADOOP-3348:
------------------------------------------

After running a few times, I see that SecureRandom.getInstance("SHA1PRNG").nextInt(Integer.MAX_VALUE)
seem to hang when setURLStreamHandlerFactor(factory) is set. main thread as seen from the
stack trace seem to hang on readBytes on file descriptor /dev/random strace. I see that this
test runs to completion 1 out of 5-6 times tough. And also calling setURLStreamingHandlerFactory
after MiniDFSCluster is up works fine.  

> TestUrlStreamHandler hangs on LINUX
> -----------------------------------
>
>                 Key: HADOOP-3348
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3348
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.18.0
>         Environment: LINUX 2.6.9
>            Reporter: lohit vijayarenu
>         Attachments: Datanode_jstack.txt
>
>
> TestUrlStreamHandler sets setURLStreamHandlerFactory as
> {noformat}
> FsUrlStreamHandlerFactory factory =
>         new org.apache.hadoop.fs.FsUrlStreamHandlerFactory();
>     java.net.URL.setURLStreamHandlerFactory(factory);
> {noformat}
> After this, MiniDFSCluster seems to hang while Datanodes tries to register in setNewStorageID,
specifically at
> {noformat}
> rand = SecureRandom.getInstance("SHA1PRNG").nextInt(Integer.MAX_VALUE);
> {noformat}
> jstack output shows that the main thread is stuck in RawLocalFileSystem$LocalFSFileInputStream.read
> (Attaching the jstack)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message