hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1127) Improve the speed of FileSystem object creation
Date Tue, 04 May 2010 21:15:08 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12864001#action_12864001

Hadoop QA commented on HDFS-1127:

-1 overall.  Here are the results of testing the latest attachment 
  against trunk revision 939918.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: http://hudson.zones.apache.org/hudson/job/Hdfs-Patch-h5.grid.sp2.yahoo.net/342/console

This message is automatically generated.

> Improve the speed of FileSystem object creation
> -----------------------------------------------
>                 Key: HDFS-1127
>                 URL: https://issues.apache.org/jira/browse/HDFS-1127
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>    Affects Versions: 0.20.1, 0.20.2
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>         Attachments: HDFS-1127.1.patch
> It takes a long time to create a lot of {{DistributedFileSystem}} object via {{FileSystem.create}}
or {{FileSystem.createNewInstance}} function.
> In our experience with scribe-hdfs, it can take up to 2 minutes for 100 such calls from
each node of a cluster of 40 nodes.
> The reason for the delay is mainly because of the lock on the CACHE object. We should
release the lock while creating new FileSystem objects.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message