hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13967) S3ABlockOutputStream to support plugin point for different multipart strategies
Date Tue, 10 Jan 2017 18:43:58 GMT
Steve Loughran created HADOOP-13967:
---------------------------------------

             Summary: S3ABlockOutputStream to support plugin point for different multipart
strategies
                 Key: HADOOP-13967
                 URL: https://issues.apache.org/jira/browse/HADOOP-13967
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: HADOOP-13345
            Reporter: Steve Loughran
            Assignee: Steve Loughran


For 0-rename commits, we need to delay the final commit of a multipart PUT, instead saving
the data needed to build that commit into the s3 bucket.

This means changes to {{S3ABlockOutputStream}} so that it can support different policies on
how to do this, "classic" and "delayed commit".

Having this self contained means we can test it in isolation of anything else.

I'm ignoring the old output stream...we will switch to fast output whenever a special destination
path is encountered



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message