hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sam rash (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1102) HftpFileSystem : errors during transfer result in truncated transfer
Date Wed, 21 Apr 2010 15:33:50 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859394#action_12859394
] 

sam rash commented on HDFS-1102:
--------------------------------

hmm, that's a server side exception.  it happens when the selection key is no longer valid
(ie the channel has been closed, maybe due to a timeout).  in this case, i don't know what
could be done server side...?

I think the appropriate fix is on the client side to detect this timeout.  i think changing
to use the client I mention above in HftpFileSystem might alleviate the silent failures.

> HftpFileSystem : errors during transfer result in truncated transfer
> --------------------------------------------------------------------
>
>                 Key: HDFS-1102
>                 URL: https://issues.apache.org/jira/browse/HDFS-1102
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, hdfs client
>    Affects Versions: 0.20.1
>            Reporter: sam rash
>
> If an error occurs transferring the data over HTTP, the HftpInputStream does not know
it received fewer bytes than the file contains.  We can at least detect this and throw an
EOFException when this occurs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message