hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3052) distch -- tool to do parallel ch*
Date Fri, 28 Mar 2008 19:12:24 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583150#action_12583150
] 

Allen Wittenauer commented on HADOOP-3052:
------------------------------------------

We estimated that it would take over a week with single threaded chown's to set permissions
on one of our bigger clusters.

Using the test distch code, we're seeing timings like 1 hour 9 minutes, 33 seconds for 198382
files using 100 nodes.

> distch -- tool to do parallel ch* 
> ----------------------------------
>
>                 Key: HADOOP-3052
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3052
>             Project: Hadoop Core
>          Issue Type: Task
>          Components: dfs
>    Affects Versions: 0.16.1
>            Reporter: Robert Chansler
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.17.0
>
>
> Build a tool to do parallel ch{mod,grp,own} on files.
> This would have the advantage over the shell -R commands in that name nodes syncs from
multiple clients are effectively batched.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message