Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9832F200C8C for ; Tue, 6 Jun 2017 14:38:27 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 96C7B160BC6; Tue, 6 Jun 2017 12:38:27 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DBFC2160BC3 for ; Tue, 6 Jun 2017 14:38:26 +0200 (CEST) Received: (qmail 7700 invoked by uid 500); 6 Jun 2017 12:38:26 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 7689 invoked by uid 99); 6 Jun 2017 12:38:26 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Jun 2017 12:38:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 9D42ACFCF5 for ; Tue, 6 Jun 2017 12:38:25 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.21 X-Spam-Level: X-Spam-Status: No, score=-99.21 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, URIBL_BLOCKED=0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id je7sKPUtq_Bq for ; Tue, 6 Jun 2017 12:38:25 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id D44485FBAB for ; Tue, 6 Jun 2017 12:38:19 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 3B14EE0630 for ; Tue, 6 Jun 2017 12:38:19 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 6440D21E0C for ; Tue, 6 Jun 2017 12:38:18 +0000 (UTC) Date: Tue, 6 Jun 2017 12:38:18 +0000 (UTC) From: "Steve Loughran (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HADOOP-14476) make InconsistentAmazonS3Client usable in downstream tests MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 06 Jun 2017 12:38:27 -0000 [ https://issues.apache.org/jira/browse/HADOOP-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038795#comment-16038795 ] Steve Loughran commented on HADOOP-14476: ----------------------------------------- patch looks good. For the extra test, something like {code} delete(dir, true) (wait for it to absolutely not be there via LambdaTest eventually()) touch(new Path(dir, "child") FileStatus st = verifyPathExists(fs, "parent dir", dir) assertIsDirectory(st) {code} > make InconsistentAmazonS3Client usable in downstream tests > ---------------------------------------------------------- > > Key: HADOOP-14476 > URL: https://issues.apache.org/jira/browse/HADOOP-14476 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3, test > Affects Versions: HADOOP-13345 > Reporter: Steve Loughran > Assignee: Aaron Fabbri > Attachments: HADOOP-14476-HADOOP-13345.001.patch > > > It's important for downstream apps to be able to verify that s3guard works by making the AWS client inconsistent (so demonstrate problems), then turn s3guard on to verify that they go away. > This can be done by exposing the {{InconsistentAmazonS3Client}} > # move the factory to the production source > # make delay configurable for when you want a really long delay > # have factory code log @ warn when a non-default factory is used. > # mention in s3a testing.md > I think we could look at the name of the option, {{fs.s3a.s3.client.factory.impl}} too. I'd like something which has "internal" in it, and without the duplication of s3a.s3 -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org