hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14633) S3Guard: optimize create codepath
Date Tue, 11 Jul 2017 13:59:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082237#comment-16082237
] 

Steve Loughran commented on HADOOP-14633:
-----------------------------------------

Did a test run here; hadn't noticed I was VPNd and so perf sucked & I got a couple of
socket timeouts.

I also saw this
{code}

Tests run: 9, Failures: 1, Errors: 0, Skipped: 8, Time elapsed: 143.187 sec <<< FAILURE!
- in org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency
testInconsistentS3ClientDeletes(org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency)  Time
elapsed: 76.924 sec  <<< FAILURE!
java.lang.AssertionError: InconsistentAmazonS3Client added back prefixes incorrectly in a
non-recursive listing expected:<3> but was:<2>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.testInconsistentS3ClientDeletes(ITestS3GuardListConsistency.java:522)
{code}

Didn't arise on an individual run. 

> S3Guard: optimize create codepath
> ---------------------------------
>
>                 Key: HADOOP-14633
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14633
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>         Environment: 
>            Reporter: Aaron Fabbri
>            Assignee: Aaron Fabbri
>            Priority: Minor
>             Fix For: HADOOP-13345
>
>         Attachments: HADOOP-14633-HADOOP-13345.001.patch
>
>
> Following up on HADOOP-14457, a couple of things to do that will improve create performance
as I mentioned in the comment [here|https://issues.apache.org/jira/browse/HADOOP-14457?focusedCommentId=16078465&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16078465]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message