hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marc-Olivier Fleury (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4616) assrtion makes fuse-dfs exit on incomplete data
Date Fri, 07 Nov 2008 14:28:46 GMT
assrtion makes fuse-dfs exit on incomplete data

                 Key: HADOOP-4616
                 URL: https://issues.apache.org/jira/browse/HADOOP-4616
             Project: Hadoop Core
          Issue Type: Bug
          Components: contrib/fuse-dfs
    Affects Versions: 0.20.0
            Reporter: Marc-Olivier Fleury
            Priority: Minor

When trying to read a file that is corrupt on HDFS (registered by the namenode, but part of
the data is missing on the datanodes), some of the assertions in dfs_read fail, causing the
program to abort. This makes it  impossible to access the mounted partition until it is mounted

A simple way to reproduce this bug is to remove enough datanodes to have part of the data
missing, and to read each file listed in HDFS.

this is the assertion that fails (fuse_dfs.c:903) : assert(bufferReadIndex >= 0 &&
bufferReadIndex < fh->bufferSize);

The expected behaviour would be to return either no file or a corrupt file, but continue working

removing the assertion seems to work for now, but a special behaviour is probably needed to
handle this particular problem correctly.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message