Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7BFAA9D5A for ; Mon, 26 Mar 2012 21:16:54 +0000 (UTC) Received: (qmail 28791 invoked by uid 500); 26 Mar 2012 21:16:54 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 28744 invoked by uid 500); 26 Mar 2012 21:16:54 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 28736 invoked by uid 99); 26 Mar 2012 21:16:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Mar 2012 21:16:54 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 Mar 2012 21:16:46 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 85D7C3472A7 for ; Mon, 26 Mar 2012 21:16:26 +0000 (UTC) Date: Mon, 26 Mar 2012 21:16:26 +0000 (UTC) From: "Daniel Dai (Commented) (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <1243222089.19618.1332796586549.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HADOOP-7209) Extensions to FsShell MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238846#comment-13238846 ] Daniel Dai commented on HADOOP-7209: ------------------------------------ The use case is user invoke rmdir from Pig script. If exception is thrown, the entire Pig script stop running. This might be expected behavior for some users, but other users just want to make sure the output path is removed before launching the mapreduce job, they don't want to fail the script. Currently Pig have a native implementation for the second case, but it would be much better FsShell provides this. > Extensions to FsShell > --------------------- > > Key: HADOOP-7209 > URL: https://issues.apache.org/jira/browse/HADOOP-7209 > Project: Hadoop Common > Issue Type: Improvement > Affects Versions: 0.20.3 > Reporter: Olga Natkovich > Assignee: Daryn Sharp > Fix For: 0.24.0 > > > Our project, Pig, exposes FsShell functionality to our end users through a shell command. We want to use this command with no modifications to make sure that whether you work with HDFS through Hadoop or Pig you get identical semantics. > The main concern that has been recently raised by our users is that there is no way to ignore certain failures that they consider to be benign, for instance, removing a non-existent directory. > We have 2 asks related to this issue: > (1) Meaningful error code returned from FsShell (we use java class) so that we can take different actions on different errors > (2) Unix like ways to tell the command to ignore certain behavior. Here are the commands that we would like to be expanded/implemented: > * rm -f > * rmdir ---ignore-fail-on-non-empty > * mkdir -p -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira