hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8924) Add pluggable interface for reading replicas in DFSClient
Date Wed, 19 Aug 2015 23:34:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703956#comment-14703956
] 

Colin Patrick McCabe commented on HDFS-8924:
--------------------------------------------

One example is a storage appliance which wanted to create a custom short-circuit read implementation.
 Creating a new BlockReader does not satisfy this use-case because this block reader would
have to have hardware-specific code which does not belong in upstream.  For example, it would
have dependencies on specific JNI and other libraries for interfacing with the hardware.

> Add pluggable interface for reading replicas in DFSClient
> ---------------------------------------------------------
>
>                 Key: HDFS-8924
>                 URL: https://issues.apache.org/jira/browse/HDFS-8924
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs-client
>    Affects Versions: 2.8.0
>            Reporter: Colin Patrick McCabe
>            Assignee: Colin Patrick McCabe
>         Attachments: HDFS-8924.001.patch
>
>
> We should add a pluggable interface for reading replicas in the DFSClient.  This could
be used to implement short-circuit reads on systems without file descriptors, or for other
optimizations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message