Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 20 Jun 2017 01:10:00 +0000 (UTC)
From: "Aaron Fabbri (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.13080973.1497920044000.53318.1497921000024@Atlassian.JIRA>
In-Reply-To: <JIRA.13080973.1497920044000@Atlassian.JIRA>
References: <JIRA.13080973.1497920044000@Atlassian.JIRA> <JIRA.13080973.1497920044921@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HADOOP-14548) S3Guard: issues running parallel
 tests w/ S3N
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Tue, 20 Jun 2017 01:10:05 -0000


    [ https://issues.apache.org/jira/browse/HADOOP-14548?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D16=
055026#comment-16055026 ]=20

Aaron Fabbri commented on HADOOP-14548:
---------------------------------------

My failures from `mvn verify -Dparallel-tests -Ds3guard -Ddynamo` in hadoop=
-tools/hadoop-aws:

{noformat}
Failed tests:
 (1) ITestS3NContractRootDir>AbstractContractRootDirectoryTest.testListEmpt=
yRootDirectory:188->Assert.assertEquals:555->Assert.assertEquals:118->Asser=
t.failNotEquals:743->Assert.fail:88 listStatus on empty root-directory retu=
rned a non-empty list expected:<0> but was:<1>
  (2) ITestJets3tNativeS3FileSystemContract>NativeS3FileSystemContractBaseT=
est.testListStatusForRoot:71 Root directory is not empty;  expected:<0> but=
 was:<1>
  (3) ITestJets3tNativeS3FileSystemContract>FileSystemContractBaseTest.test=
ListStatus:321 expected:<1> but was:<12>

Tests in error:
  (4) ITestS3AContractRootDir>AbstractContractRootDirectoryTest.testRmEmpty=
RootDirNonRecursive:116 =C2=BB PathIO
  (5) ITestS3AEncryptionSSEC.testCreateFileThenMoveWithDifferentSSECKey:136=
->lambda$testCreateFileThenMoveWithDifferentSSECKey$14:147
  (6) ITestJets3tNativeS3FileSystemContract>FileSystemContractBaseTest.test=
LSRootDir:847->FileSystemContractBaseTest.assertListFilesFinds:865 =C2=BB F=
ileNotFound
{noformat}

 #4  Happens because root was not empty.  Wondering if S3N folder objects c=
aused the isEmptyDirectory() to be false?

[~mackrorysd] any thoughts on #5?

> S3Guard: issues running parallel tests w/ S3N=20
> ----------------------------------------------
>
>                 Key: HADOOP-14548
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14548
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Aaron Fabbri
>
> In general, running S3Guard and parallel tests with S3A and S3N contract =
tests enabled is asking for trouble:  S3Guard code assumes there are not ot=
her non-S3Guard clients modifying the bucket.
> Goal of this JIRA is to:
> - Discuss current failures running `mvn verify -Dparallel-tests -Ds3guard=
 -Ddynamo` with S3A and S3N contract tests configured.
> - Identify any failures here that are worth looking into.
> - Document (or enforce) that people should not do this, or should expect =
failures if they do.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org