flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From NicoK <...@git.apache.org>
Subject [GitHub] flink issue #3512: [FLINK-6008] collection of BlobServer improvements
Date Tue, 25 Apr 2017 08:54:04 GMT
Github user NicoK commented on the issue:

    After investigating a bit further, I noticed that this problem is actually a bit bigger:
    Even in `FileSystemBlobStore`, there is no guarantee that a directory will not be deleted
concurrently (from a `delete` method) between its creation and writing a file during (in a
`get` method):
    * the `delete` method for name-addressable blobs always deletes the job-specific storage
directory if there is no further blob for this job
    * the content-addressable blobs do that similarly but are shared among jobs and thus only
delete directories if there is no other blob.
    Since name-addressable blobs have not been used so far and the latter case typically does
not occur concurrently with `get` requests, this has not been a problem so far.
    Therefore, I suggest to create a separate JIRA for this (delete vs. get) concurrency issue
and apply a quick fix for #3742.

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.

View raw message