hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sam rash (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1102) HftpFileSystem : errors during transfer result in truncated transfer
Date Tue, 20 Apr 2010 09:39:57 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12858750#action_12858750
] 

sam rash commented on HDFS-1102:
--------------------------------

proposed solution:

StreamFile: Datanode will set the content length in the header
HftpInputStream: read() method will verify that when underlying input stream from the http
connection returns -1 that it has all the bytes, else throws an EOFException


> HftpFileSystem : errors during transfer result in truncated transfer
> --------------------------------------------------------------------
>
>                 Key: HDFS-1102
>                 URL: https://issues.apache.org/jira/browse/HDFS-1102
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, hdfs client
>    Affects Versions: 0.20.1
>            Reporter: sam rash
>
> If an error occurs transferring the data over HTTP, the HftpInputStream does not know
it received fewer bytes than the file contains.  We can at least detect this and throw an
EOFException when this occurs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message