beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Robertson (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-5429) Optimise GCSFilesystem rename implementation
Date Wed, 19 Sep 2018 13:17:00 GMT
Tim Robertson created BEAM-5429:
-----------------------------------

             Summary: Optimise GCSFilesystem rename implementation
                 Key: BEAM-5429
                 URL: https://issues.apache.org/jira/browse/BEAM-5429
             Project: Beam
          Issue Type: Improvement
          Components: io-java-gcp
    Affects Versions: 2.6.0
            Reporter: Tim Robertson
            Assignee: Chamikara Jayalath


{{GCSFileSystem}} implements a {{rename()}} with a {{copy}} and {{delete}} operation.

However, GCS has an [Objects: rewrite|https://cloud.google.com/storage/docs/json_api/v1/objects/rewrite]
which looks like it would be a metadata operation only and therefore has the potential to
be much quicker.

Once BEAM-5036 is fixed IOs that write files will make use of a {{rename}} operation.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message