hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Mackrory (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14548) S3Guard: issues running parallel tests w/ S3N
Date Wed, 21 Jun 2017 22:25:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058365#comment-16058365

Sean Mackrory commented on HADOOP-14548:

{code}Sean Mackrory any thoughts on #5?{code}

The SSEC tests aren't supposed to be running in parallel. They're not, right? I'd suggest
2 likely explanations are that (1) it's failing because of something left behind when one
of the S3N tests fails and left behind an object that is sometimes ignored by s3a but sometimes
not (has happened to me a lot) or (2) that test is expected to throw an exception somewhere
that always get short-circuited by S3Guard when it's enabled (see HADOOP-14448 - though I'm
not sure what's changed since I fixed some others).

> S3Guard: issues running parallel tests w/ S3N 
> ----------------------------------------------
>                 Key: HADOOP-14548
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14548
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Aaron Fabbri
>            Assignee: Aaron Fabbri
>            Priority: Minor
> In general, running S3Guard and parallel tests with S3A and S3N contract tests enabled
is asking for trouble:  S3Guard code assumes there are not other non-S3Guard clients modifying
the bucket.
> Goal of this JIRA is to:
> - Discuss current failures running `mvn verify -Dparallel-tests -Ds3guard -Ddynamo` with
S3A and S3N contract tests configured.
> - Identify any failures here that are worth looking into.
> - Document (or enforce) that people should not do this, or should expect failures if
they do.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message