Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2F8C7E8C6 for ; Fri, 1 Feb 2013 00:07:13 +0000 (UTC) Received: (qmail 77373 invoked by uid 500); 1 Feb 2013 00:07:12 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 77339 invoked by uid 500); 1 Feb 2013 00:07:12 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 77276 invoked by uid 99); 1 Feb 2013 00:07:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Feb 2013 00:07:12 +0000 Date: Fri, 1 Feb 2013 00:07:12 +0000 (UTC) From: "Steve Loughran (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HADOOP-9261) S3n filesystem can move a directory under itself -and so lose data MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-9261: ----------------------------------- Status: Open (was: Patch Available) A further test shows that rename-onto-self can play up; need to incorporate this into the patch too with a src.equals(dst) check > S3n filesystem can move a directory under itself -and so lose data > ------------------------------------------------------------------ > > Key: HADOOP-9261 > URL: https://issues.apache.org/jira/browse/HADOOP-9261 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 > Affects Versions: 2.0.2-alpha, 1.1.1 > Environment: Testing against S3 bucket stored on US West (Read after Write consistency; eventual for read-after-delete or write-after-write) > Reporter: Steve Loughran > Attachments: HADOOP-9261.patch > > > The S3N filesystem {{rename()}} doesn't make sure that the destination directory is not a child or other descendant of the source directory. The files are copied to the new destination, then the source directory is recursively deleted, so losing data. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira