hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ian Nowland (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-5836) Bug in S3N handling of directory markers using an object with a trailing "/" causes jobs to fail
Date Thu, 14 May 2009 17:57:45 GMT
Bug in S3N handling of directory markers using an object with a trailing "/" causes jobs to
fail
------------------------------------------------------------------------------------------------

                 Key: HADOOP-5836
                 URL: https://issues.apache.org/jira/browse/HADOOP-5836
             Project: Hadoop Core
          Issue Type: Bug
          Components: fs/s3
    Affects Versions: 0.18.3
            Reporter: Ian Nowland


Some tools which upload to S3 and use a object terminated with a "/" as a directory marker,
for instance "s3n://mybucket/mydir/". If asked to iterate that "directory" via listStatus(),
then the current code will return an empty file "", which the InputFormatter happily assigns
to a split, and which later causes a task to fail, and probably the job to fail. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message