hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-909) dfs "du" shows that the size of a subdirectory is 0
Date Tue, 23 Jan 2007 01:33:49 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12466610

Hairong Kuang commented on HADOOP-909:

After some further investigation, it turns out that the new FsShell does not handle the "du"
command correctly. The size of a direcotry tree should be fetched using getContentLength not

> dfs "du" shows that the size of a subdirectory is 0
> ---------------------------------------------------
>                 Key: HADOOP-909
>                 URL: https://issues.apache.org/jira/browse/HADOOP-909
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.10.1
>            Reporter: Hairong Kuang
>         Assigned To: Hairong Kuang
> dfs "du" is implemented by sending a listPaths request to the namenode to get the size
of each file/subdir under the directory. At the namenode side, the size of subdir was calculated
by recursively going through the whole subtree with the subdir as the root. But starting from
the release 0.10.0, the size of subdir is no longer gets calculated. So dfs "du" shows its
size as 0.
> The problem is that both "du" and "list" send the same request "listPaths" to the  namenode.
The previous implmentation made list very expensive, but the current implementation makes
du not working.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message