hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HADOOP-13514) Upgrade maven surefire plugin to 2.19.1
Date Thu, 12 Oct 2017 19:52:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202523#comment-16202523
] 

Steve Loughran edited comment on HADOOP-13514 at 10/12/17 7:51 PM:
-------------------------------------------------------------------

Just tracked this down as the reason my stack traces don't appear no more.

Before: full stack trace on assertion failure, including nested entries. Enables me to track
down the problem through copy and paste into IDE.

After: one line toString value of raised assertion.

{code}
...

Tests run: 18, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 129.494 sec <<<
FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AContractGetFileStatusV1List
testComplexDirActions(org.apache.hadoop.fs.s3a.ITestS3AContractGetFileStatusV1List)  Time
elapsed: 92.017 sec  <<< ERROR!
org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on fork-0004/test/testComplexDirActions/dir-0-0002/dir-0-0002-0002/:
com.amazonaws.services.s3.model.AmazonS3Exception: Internal Server Error (Service: Amazon
S3; Status Code: 500; Error Code: 500 Internal Server Error; Request ID: AFF8F7D8E3CD3A88;
S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=),
S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=:500
Internal Server Error: Internal Server Error (Service: Amazon S3; Status Code: 500; Error
Code: 500 Internal Server Error; Request ID: AFF8F7D8E3CD3A88; S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=)
Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: Internal Server Error (Service:
Amazon S3; Status Code: 500; Error Code: 500 Internal Server Error; Request ID: AFF8F7D8E3CD3A88;
S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=)

...
Results :

Tests in error: 
  ITestS3AContractGetFileStatusV1List>AbstractContractGetFileStatusTest.testComplexDirActions:142->AbstractContractGetFileStatusTest.createTestTree:421
» AWSS3IO

Tests run: 473, Failures: 0, Errors: 1, Skipped: 21
{code}


was (Author: stevel@apache.org):
Just tracked this down as the reason my stack traces don't appear no more.

Before: full stack trace on assertion failure, including nested entries. Enables me to track
down the problem through copy and paste into IDE.

After: one line toString value of raised assertion.

{code}
...

Tests run: 18, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 129.494 sec <<<
FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3AContractGetFileStatusV1List
testComplexDirActions(org.apache.hadoop.fs.s3a.ITestS3AContractGetFileStatusV1List)  Time
elapsed: 92.017 sec  <<< ERROR!
org.apache.hadoop.fs.s3a.AWSS3IOException: getFileStatus on fork-0004/test/testComplexDirActions/dir-0-0002/dir-0-0002-0002/:
com.amazonaws.services.s3.model.AmazonS3Exception: Internal Server Error (Service: Amazon
S3; Status Code: 500; Error Code: 500 Internal Server Error; Request ID: AFF8F7D8E3CD3A88;
S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=),
S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=:500
Internal Server Error: Internal Server Error (Service: Amazon S3; Status Code: 500; Error
Code: 500 Internal Server Error; Request ID: AFF8F7D8E3CD3A88; S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=)
Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: Internal Server Error (Service:
Amazon S3; Status Code: 500; Error Code: 500 Internal Server Error; Request ID: AFF8F7D8E3CD3A88;
S3 Extended Request ID: U8W07ULDBLuCZWkZsdIkbj87JbceAunvWxvPS6niWl0Hpw96aGB2YttHYamRX7ZosLigip1iKg4=)

...
Results :

Tests in error: 
  ITestS3AContractGetFileStatusV1List>AbstractContractGetFileStatusTest.testComplexDirActions:142->AbstractContractGetFileStatusTest.createTestTree:421
» AWSS3IO

Tests run: 473, Failures: 0, Errors: 1, Skipped: 21
{code{

> Upgrade maven surefire plugin to 2.19.1
> ---------------------------------------
>
>                 Key: HADOOP-13514
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13514
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 2.8.0
>            Reporter: Ewan Higgs
>            Assignee: Akira Ajisaka
>             Fix For: 3.0.0
>
>         Attachments: HADOOP-13514-addendum.01.patch, HADOOP-13514-testing.001.patch,
HADOOP-13514-testing.002.patch, HADOOP-13514-testing.003.patch, HADOOP-13514-testing.004.patch,
HADOOP-13514.002.patch, HADOOP-13514.003.patch, surefire-2.19.patch
>
>
> A lot of people working on Hadoop don't want to run all the tests when they develop;
only the bits they're working on. Surefire 2.19 introduced more useful test filters which
let us run a subset of the tests that brings the build time down from 'come back tomorrow'
to 'grab a coffee'.
> For instance, if I only care about the S3 adaptor, I might run:
> {code}
> mvn test -Dmaven.javadoc.skip=true -Pdist,native -Djava.awt.headless=true \"-Dtest=org.apache.hadoop.fs.*,
org.apache.hadoop.hdfs.*, org.apache.hadoop.fs.s3a.*\"
> {code}
> We can work around this by specifying the surefire version on the command line but it
would be better, imo, to just update the default surefire used.
> {code}
> mvn test -Dmaven.javadoc.skip=true -Pdist,native -Djava.awt.headless=true \"-Dtest=org.apache.hadoop.fs.*,
org.apache.hadoop.hdfs.*, org.apache.hadoop.fs.s3a.*\" -Dmaven-surefire-plugin.version=2.19.1
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message