hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3667) Add retry support to WebHdfsFileSystem
Date Thu, 02 Aug 2012 02:02:02 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427073#comment-13427073

Tsz Wo (Nicholas), SZE commented on HDFS-3667:

> HftpFileSystem.java no change in branch-1?

Yes.  It is because HftpFileSystem does not use ByteRangeInputStream in branch-1, i.e. it
does not support seek.

> Runner#shouldRetry() has different code. Is it due to difference between branch-1 and

Yes.  In trunk, the RPC retry policy was changed by the HA work.

> {{ conn.setRequestProperty("Content-Type", "application/octet-stream");}} is not set
in branch-1 patch?

No, we have the following
      conn.setRequestProperty("Content-Type", MediaType.APPLICATION_OCTET_STREAM);

> Add retry support to WebHdfsFileSystem
> --------------------------------------
>                 Key: HDFS-3667
>                 URL: https://issues.apache.org/jira/browse/HDFS-3667
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: webhdfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 2.0.1-alpha
>         Attachments: h3667_20120718.patch, h3667_20120721.patch, h3667_20120722.patch,
h3667_20120725.patch, h3667_20120730.patch, h3667_20120730_b-1.patch
> DFSClient (i.e. DistributedFileSystem) has a configurable retry policy and it retries
on exceptions such as connection failure, safemode.  WebHdfsFileSystem should have similar
retry support.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message