hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Powell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5194) Robust support for alternate FsDatasetSpi implementations
Date Wed, 15 Jan 2014 21:25:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13872613#comment-13872613
] 

David Powell commented on HDFS-5194:
------------------------------------

Hi Arpit,

Thanks for taking a look.  I'll try to work a requirements section into the next version of
the doc.  For the time being, I'd summarize the key FsDatasetSpi requirements as:

- Support for non-File access (versatility)
- Support for implementations outside the org.apache.hadoop package (modularity, cleanliness)
- Support for short circuit (performance)
- Testing to ensure the above requirements continue to be met


> Robust support for alternate FsDatasetSpi implementations
> ---------------------------------------------------------
>
>                 Key: HDFS-5194
>                 URL: https://issues.apache.org/jira/browse/HDFS-5194
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode, hdfs-client
>            Reporter: David Powell
>            Priority: Minor
>         Attachments: HDFS-5194.design.09112013.pdf, HDFS-5194.patch.09112013
>
>
> The existing FsDatasetSpi interface is well-positioned to permit extending Hadoop to
run natively on non-traditional storage architectures.  Before this can be done, however,
a number of gaps need to be addressed.  This JIRA documents those gaps, suggests some solutions,
and puts forth a sample implementation of some of the key changes needed.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message