hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sam rash (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1102) HftpFileSystem : errors during transfer result in truncated transfer
Date Tue, 20 Apr 2010 20:46:50 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859056#action_12859056

sam rash commented on HDFS-1102:

well, it's not w/o modifying hftp, but a client can verify the content length if it's there,
and proceed as it does now if it's not present.

we could also have a config option that say "enforce content length" which would cause missing
content length => throw IOException.

in this way, if both the client and server are on the latest hftp, this works, else it will
work as before

offhand, i'm not sure how to do this without either changing hftp or wrapping it in some other
protocol that does length checking

> HftpFileSystem : errors during transfer result in truncated transfer
> --------------------------------------------------------------------
>                 Key: HDFS-1102
>                 URL: https://issues.apache.org/jira/browse/HDFS-1102
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, hdfs client
>    Affects Versions: 0.20.1
>            Reporter: sam rash
> If an error occurs transferring the data over HTTP, the HftpInputStream does not know
it received fewer bytes than the file contains.  We can at least detect this and throw an
EOFException when this occurs.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message