hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4377) Race condition creating S3 buffer directory for NativeS3FileSystem
Date Sat, 08 Nov 2008 16:48:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646000#action_12646000

Hudson commented on HADOOP-4377:

Integrated in Hadoop-trunk #655 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/655/])
    . Fix a race condition in directory creation in
NativeS3FileSystem. Contributed by David Phillips.

> Race condition creating S3 buffer directory for NativeS3FileSystem
> ------------------------------------------------------------------
>                 Key: HADOOP-4377
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4377
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: fs/s3
>    Affects Versions: 0.18.1
>            Reporter: David Phillips
>            Assignee: David Phillips
>             Fix For: 0.20.0
>         Attachments: hadoop-s3n-tmpdir.patch, hadoop-s3n-tmpdir.patch
> The buffer directory is checked for existence, then created if it doesn't exist.  But
the create can fail if the another process creates it in between.  We can fix this by checking
for existence again if the create fails.  I've seen "Cannot create S3 buffer directory" occur,
and this race is the most plausible explanation.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message