hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7209) Extensions to FsShell
Date Mon, 26 Mar 2012 21:16:26 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238846#comment-13238846

Daniel Dai commented on HADOOP-7209:

The use case is user invoke rmdir from Pig script. If exception is thrown, the entire Pig
script stop running. This might be expected behavior for some users, but other users just
want to make sure the output path is removed before launching the mapreduce job, they don't
want to fail the script. Currently Pig have a native implementation for the second case, but
it would be much better FsShell provides this.
> Extensions to FsShell
> ---------------------
>                 Key: HADOOP-7209
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7209
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 0.20.3
>            Reporter: Olga Natkovich
>            Assignee: Daryn Sharp
>             Fix For: 0.24.0
> Our project, Pig, exposes FsShell functionality to our end users through a shell command.
We want to use this command with no modifications to make sure that whether you work with
HDFS through Hadoop or Pig you get identical semantics.
> The main concern that has been recently raised by our users is that there is no way to
ignore certain failures that they consider to be benign, for instance, removing a non-existent
> We have 2 asks related to this issue:
> (1) Meaningful error code returned from FsShell (we use java class) so that we can take
different actions on different errors
> (2) Unix like ways to tell the command to ignore certain behavior. Here are the commands
that we would like to be expanded/implemented:
>    * rm -f
>    * rmdir ---ignore-fail-on-non-empty
>    * mkdir -p 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message