Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 038E0EB1A for ; Mon, 11 Mar 2013 15:43:06 +0000 (UTC) Received: (qmail 29594 invoked by uid 500); 11 Mar 2013 15:43:03 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 29267 invoked by uid 500); 11 Mar 2013 15:43:00 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 29237 invoked by uid 99); 11 Mar 2013 15:42:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Mar 2013 15:42:59 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of stevel@hortonworks.com designates 209.85.212.49 as permitted sender) Received: from [209.85.212.49] (HELO mail-vb0-f49.google.com) (209.85.212.49) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Mar 2013 15:42:55 +0000 Received: by mail-vb0-f49.google.com with SMTP id s24so1697632vbi.22 for ; Mon, 11 Mar 2013 08:42:34 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type:x-gm-message-state; bh=wY3eAuKLCE9wKXTAawM8ayGwv9za/cTYfrPRaze3TOk=; b=LVAzQlnFjyNLWopIzl16AZVAarI8Sr2pghdKyN7KOkVUfTlXOBID9Gj0rpFzRK0eKu W71Df83L0xHG518yX2deB7hQezlCOsQA5CC/vV7dEgB7iihtz20Ogg4KYBEKFCPexaGW x01w1HhkqLRbK1ggSu1iYuz/3wBrmsG5iR2s/iz8/+cfSeWBeNaNDMjwcS3t6aluOmHt 5rdABkOw7cXEATScGEFxfJAoUsgDRG+E4TLFjciY7NtIlf8TTXNPFl3DL3jOG/YruOHo aLE9jMnF41YLuO58P7dLIIF7jsaXapbGRNc5ku1BvkOKEOFS77qS6w2pLjztSX5aIIW6 vB9g== MIME-Version: 1.0 X-Received: by 10.52.88.197 with SMTP id bi5mr4374920vdb.58.1363016553968; Mon, 11 Mar 2013 08:42:33 -0700 (PDT) Received: by 10.58.33.36 with HTTP; Mon, 11 Mar 2013 08:42:33 -0700 (PDT) In-Reply-To: References: Date: Mon, 11 Mar 2013 15:42:33 +0000 Message-ID: Subject: Re: [PROPOSAL] Hadoop branch-1.2 From: Steve Loughran To: common-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec501c55885cfa804d7a80567 X-Gm-Message-State: ALoCoQlvtSkH5HjgXszVAGGLl5w+LxOXLV5RWbXDnXsxhWnPy6rur8PijbIz7TM9z5a+IVEVJo/9 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec501c55885cfa804d7a80567 Content-Type: text/plain; charset=UTF-8 On 10 March 2013 18:32, Suresh Srinivas wrote: > Steve, is there a timeline all these changes will be ready? If it is not > going to be > ready soon, perhaps these changes could be consider for 1.3? > > Suresh, I've put everything into https://issues.apache.org/jira/browse/HADOOP-9258 - the tests and the patches for S3 and S3N. Data loss is only going to happen if you go rename(srcDir, srcDir) or rename(srcDir,srcDir/child); nobody has ever reported it. We have to decide whether this is critical enough to get in, or postpone to 1.3. Given this is a last minute change and the changes to the S3FileSystem's rename() operation are significant, delaying to 1.3 may actually be safer. your choice -steve --bcaec501c55885cfa804d7a80567--