Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 12EED200CFC for ; Wed, 13 Sep 2017 19:15:09 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 11BFE1609C3; Wed, 13 Sep 2017 17:15:09 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 65B4C1609CA for ; Wed, 13 Sep 2017 19:15:08 +0200 (CEST) Received: (qmail 56056 invoked by uid 500); 13 Sep 2017 17:15:05 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 56042 invoked by uid 99); 13 Sep 2017 17:15:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Sep 2017 17:15:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5BB4A1A50FF for ; Wed, 13 Sep 2017 17:15:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id nmdqemBZPhUp for ; Wed, 13 Sep 2017 17:15:04 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 34CCC5F23E for ; Wed, 13 Sep 2017 17:15:04 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 207F7E0F0E for ; Wed, 13 Sep 2017 17:15:03 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 4BF6C25395 for ; Wed, 13 Sep 2017 17:15:01 +0000 (UTC) Date: Wed, 13 Sep 2017 17:15:01 +0000 (UTC) From: "Steve Loughran (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 13 Sep 2017 17:15:09 -0000 [ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14738: ------------------------------------ Status: Open (was: Patch Available) > Remove S3N and obsolete bits of S3A; rework docs > ------------------------------------------------ > > Key: HADOOP-14738 > URL: https://issues.apache.org/jira/browse/HADOOP-14738 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Affects Versions: 2.9.0, 3.0.0-beta1 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Blocker > Attachments: HADOOP-14738-002.patch, HADOOP-14738-003.patch, HADOOP-14738-004.patch, HADOOP-14738-005.patch, HADOOP-14739-001.patch > > > We are all happy with S3A; it's been stable since Hadoop 2.7 and high-perf since Hadoop 2.8 > It's now time to kill S3N off, remove the source, the tests, the transitive dependencies. This patch does that. > It also removes the obsolete, original s3a output stream; the fast/block upload stream has been stable and is much more manageable and maintained (put differently: we don't ever look at the original S3A output stream, and tell people not to use it for performance reasons). > As well as cutting the features, this patch updates the aws docs with > * split out s3n migration page > * split out troubleshooting page > * rework of the "uploading data with s3a" section of index.md, as there's no need to discuss the slow upload except in the past tense...all that is needed is to list the buffering and thread tuning options of the block uploader. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org