hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Fabbri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14323) ITestS3GuardListConsistency failure w/ Local, authoritative metadata store
Date Wed, 19 Apr 2017 07:59:41 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974274#comment-15974274

Aaron Fabbri commented on HADOOP-14323:

Looks like the NPE is here:

    mdResults = S3Guard.getMetadataStore(noWriteBack).listChildren(directory);
    assertEquals("Metadata store without write back should still only know "
            + "about /OnS3AndMS, but it has: " + mdResults,
        1, mdResults.numEntries());

In that last line, which implies mdResults is null.  This test should probably check allowMissing()
(if the MetadataStore may drop entries).. In this case, though, I doubt LocalMetadataStore
LRU-evicted the entry already, as it defaults to a MRU queue size of 128.

> ITestS3GuardListConsistency failure w/ Local, authoritative metadata store
> --------------------------------------------------------------------------
>                 Key: HADOOP-14323
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14323
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: s3
>    Affects Versions: HADOOP-13345
>            Reporter: Aaron Fabbri
>            Priority: Minor
> When doing some testing for HADOOP-14266 I noticed this test failure:
> {noformat}
> java.lang.NullPointerException: null
>         at org.apache.hadoop.fs.s3a.ITestS3GuardListConsistency.testListStatusWriteBack(ITestS3GuardListConsistency.java:317)
> {noformat}
> I was running with LocalMetadataStore and {{fs.s3a.metadatastore.authoritative}} set
to true.  I haven't been testing this mode recently so not sure if this case ever worked.
 Lower priority but we should fix it.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message