hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4377) Race condition creating S3 buffer directory for NativeS3FileSystem
Date Fri, 07 Nov 2008 23:45:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Douglas updated HADOOP-4377:

       Resolution: Fixed
    Fix Version/s: 0.20.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

I just committed this. Thanks, David

> Race condition creating S3 buffer directory for NativeS3FileSystem
> ------------------------------------------------------------------
>                 Key: HADOOP-4377
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4377
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: fs/s3
>    Affects Versions: 0.18.1
>            Reporter: David Phillips
>            Assignee: David Phillips
>             Fix For: 0.20.0
>         Attachments: hadoop-s3n-tmpdir.patch, hadoop-s3n-tmpdir.patch
> The buffer directory is checked for existence, then created if it doesn't exist.  But
the create can fail if the another process creates it in between.  We can fix this by checking
for existence again if the create fails.  I've seen "Cannot create S3 buffer directory" occur,
and this race is the most plausible explanation.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message