hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Chansler (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4377) Race condition creating S3 buffer directory for NativeS3FileSystem
Date Tue, 03 Mar 2009 18:58:56 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Robert Chansler updated HADOOP-4377:

    Release Note:   (was: Fix "Cannot create S3 buffer directory" race condition error)

No published release note for "just a bug."

> Race condition creating S3 buffer directory for NativeS3FileSystem
> ------------------------------------------------------------------
>                 Key: HADOOP-4377
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4377
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: fs/s3
>    Affects Versions: 0.18.1
>            Reporter: David Phillips
>            Assignee: David Phillips
>             Fix For: 0.20.0
>         Attachments: hadoop-s3n-tmpdir.patch, hadoop-s3n-tmpdir.patch
> The buffer directory is checked for existence, then created if it doesn't exist.  But
the create can fail if the another process creates it in between.  We can fix this by checking
for existence again if the create fails.  I've seen "Cannot create S3 buffer directory" occur,
and this race is the most plausible explanation.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message