hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1834) Accelerate chmod task in ant files
Date Tue, 26 Jul 2011 19:50:10 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071313#comment-13071313

Daryn Sharp commented on HDFS-1834:

For some reason ant uses the shell command chmod instead of the libc chmod...  Also from the
apache ant manual:

bq. By default this task will use a single invocation of the underlying chmod command. If
you are working on a large number of files this may result in a command line that is too long
for your operating system. If you encounter such problems, you should set the maxparallel
attribute of this task to a non-zero value. The number to use highly depends on the length
of your file names (the depth of your directory tree) and your operating system, so you'll
have to experiment a little. POSIX recommends command line length limits of at least 4096
characters, this may give you an approximation for the number you could use as initial value
for these experiments.

Would you be willing to please post the updated patch to save me the duplicate effort?

> Accelerate chmod task in ant files
> ----------------------------------
>                 Key: HDFS-1834
>                 URL: https://issues.apache.org/jira/browse/HDFS-1834
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 0.23.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>         Attachments: HDFS-1834.patch
> The chmod tasks have a parallel="false" attribute attached to them.  This causes ant
to shell out for each and every item in the fileset which slows down parts of the build.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message