hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15003) Merge S3A committers into trunk: Yetus patch checker
Date Tue, 07 Nov 2017 14:21:01 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242082#comment-16242082
] 

Steve Loughran commented on HADOOP-15003:
-----------------------------------------

that huge read test is the one designed to execute each method in a strict order (which is
why we have BASIC/APL-style numbering of each methods. It does still use the fork ID to calculate
the test path. And they should all be set up to run in the sequential phase anyway

Looking at the new scale test {{ITestHugeMagicCommits}}, its overridden the tests (50, 100)
to skip them as superfluous, and test 999, the cleanup adding 
an abort for all commits as well as an extra delete of the magic dir (which should again be
superfluous).

Also, even though the tests are using fork-specific paths, they are using the same path in
each of the huge tests for their own files; I like to isolate them more just for all that
metadata consistency stuff. So I'll set the logic for all the huge reads to do that

# I'll mark the _040_ test as unneeded there too
# review the bits of the pom where the test sequences are set up. Looks like there's an old
ref to a JetS3t test there to go.
# And review the test _999 teardown




> Merge S3A committers into trunk: Yetus patch checker
> ----------------------------------------------------
>
>                 Key: HADOOP-15003
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15003
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>         Attachments: HADOOP-13786-041.patch, HADOOP-13786-042.patch, HADOOP-13786-043.patch,
HADOOP-13786-044.patch, HADOOP-13786-045.patch
>
>
> This is a Yetus only JIRA created to have Yetus review the HADOOP-13786/HADOOP-14971
patch as a .patch file, as the review PR [https://github.com/apache/hadoop/pull/282] is stopping
this happening in HADOOP-14971.
> Reviews should go into the PR/other task



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message