hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-263) fsck -files -blocks -locations is a little slow
Date Sat, 19 Nov 2011 20:22:52 GMT

     [ https://issues.apache.org/jira/browse/HDFS-263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Harsh J resolved HDFS-263.
--------------------------

    Resolution: Cannot Reproduce

Doesn't look like there's a problem today:

1339947 files and directories, 1345767 blocks:

{code}
[harsh@01 ~]$ time sudo -u hdfs hadoop fsck / &> /dev/null

real	0m25.126s
user	0m1.972s
sys	0m0.268s
[harsh@01 ~]$ time sudo -u hdfs hadoop fsck / -files &> /dev/null

real	0m26.307s
user	0m4.376s
sys	0m0.602s
[harsh@01 ~]$ time sudo -u hdfs hadoop fsck / -files -blocks -locations &> /
dev/null

real	0m27.712s
user	0m6.900s
sys	0m1.126s
{code}
                
> fsck -files -blocks -locations is a little slow
> -----------------------------------------------
>
>                 Key: HDFS-263
>                 URL: https://issues.apache.org/jira/browse/HDFS-263
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Koji Noguchi
>            Assignee: Lohit Vijayarenu
>            Priority: Minor
>
> fsck on one subdirectory. 
> about 50,000 files (50,000 blocks) 
> fsck  /user/aaa            3 seconds
> fsck /user/aaa -files   30 seconds
> fsck /user/aaa -files -blocks -locations 90 seconds. 
> It depends on the network, but could it be a little faster?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message