hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11361) Block Storage : add cache interface
Date Tue, 21 Mar 2017 00:00:44 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chen Liang updated HDFS-11361:
    Attachment: HDFS-11361-HDFS-7240.004.patch

Thanks [~anu] for the comments! Post v004 patch to include a simple test. This JIRA is mainly
to add the cache placeholder and the caller stack, and the more sophisticated actual implementation
is in HDFS-11537. The unit test to verify the actual read/write operation will be included
in HDFS-11537 instead.

> Block Storage : add cache interface
> -----------------------------------
>                 Key: HDFS-11361
>                 URL: https://issues.apache.org/jira/browse/HDFS-11361
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>         Attachments: HDFS-11361-HDFS-7240.001.patch, HDFS-11361-HDFS-7240.002.patch,
HDFS-11361-HDFS-7240.003.patch, HDFS-11361-HDFS-7240.004.patch
> This JIRA includes two major pieces: 1. the interface exposed to upper layer operating
system that mounts the file system; and 2. the interface exposed to lower layer container
storage layer.
> On one hand, to make CBlock mountable and accessible for a POSIX OS, we need to implement
file system protocol. We chose to do this by running cblock with jSCSI (http://jscsi.org/)
which is a java implementation of iSCSI protocol. More specifically, CBlock volume will exposed
as an java-based iSCSI target, and any machine that has iSCSI installed will be able to talk
to CBlock volume and mounted locally just as any disks. This is JIRA make a starting point
by introducing jSCSI and implementing its {{IStorageModule}}. This will be registered to jSCSI
server in future JIRA. 
> One the other hand, to be able to have the CBlock talk to container layer with better
performance, CBlock should be able to cache data locally. More specifically, clients' read/write
should be performed on the locally disk cache, while threads are pushing and retrieving data
in backend. This JIRA takes the first step by defining interfaces for the local cache. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message