Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 30 May 2017 21:05:06 +0000 (UTC)
From: "Aaron Fabbri (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <JIRA.13075979.1496178296000.324742.1496178306014@Atlassian.JIRA>
In-Reply-To: <JIRA.13075979.1496178296000@Atlassian.JIRA>
References: <JIRA.13075979.1496178296000@Atlassian.JIRA> <JIRA.13075979.1496178296811@jira-lw-us.apache.org>
Subject: [jira] [Created] (HADOOP-14467) S3Guard: Improve FNFE message when
 opening a stream
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 30 May 2017 21:05:12 -0000

Aaron Fabbri created HADOOP-14467:
-------------------------------------

             Summary: S3Guard: Improve FNFE message when opening a stream
                 Key: HADOOP-14467
                 URL: https://issues.apache.org/jira/browse/HADOOP-14467
             Project: Hadoop Common
          Issue Type: Sub-task
            Reporter: Aaron Fabbri
            Assignee: Aaron Fabbri


Following up on the [discussion on HADOOP-13345|https://issues.apache.org/jira/browse/HADOOP-13345?focusedCommentId=16030050&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16030050], because S3Guard can serve getFileStatus() from the MetadataStore without doing a HEAD on S3, a FileNotFound error on a file due to S3 GET inconsistency does not happen on open(), but on the first read of the stream.  We may add retries to the S3 client in the future, but for now we should have an exception message that indicates this may be due to inconsistency (assuming it isn't a more straightforward case like someone deleting the object out from under you).

This is expected to be a rare case, since the S3 service is now mostly consistent for GET.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org