hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Zeller (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-594) Add support for byte-ranges to hsftp
Date Thu, 03 Sep 2009 23:29:57 GMT

    [ https://issues.apache.org/jira/browse/HDFS-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12751220#action_12751220
] 

Bill Zeller commented on HDFS-594:
----------------------------------

In both HftpFileSystem and HsftpFileSystem, the method openConnection(String path, String
query) opens an Http[s]URLConnection to a server and returns it. To support byte ranges, HftpFileSystem
was modified to provide ByteRangeInputStream with a URL. ByteRangeInputStream opens this URL
(with a different byte-range header) each time seek() is called. 

HsftpFileSystem is more complicated, because opening an HTTPS URL requires doing some verification
of the hostname and certificate. This logic would either need to be moved out of HsftpFileSystem,
our openConnection could be overloaded to create a static method that would do this verification
(and called by ByteRangeInputStream). 

> Add support for byte-ranges to hsftp
> ------------------------------------
>
>                 Key: HDFS-594
>                 URL: https://issues.apache.org/jira/browse/HDFS-594
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs client
>    Affects Versions: 0.21.0
>            Reporter: Bill Zeller
>             Fix For: 0.21.0
>
>
> HsftpFileSystem should be modified to support byte-ranges so it has the same semantics
as HftpFileSystem after committing HDFS-235. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message