hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-11361) Block Storage : add cache interface
Date Tue, 21 Mar 2017 22:25:41 GMT

     [ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chen Liang updated HDFS-11361:
------------------------------
    Attachment: HDFS-11361-HDFS-7240.007.patch

The previous has duplicate change as in recently checked-in JIRA HDFS-11162. Repost v007 patch
to exclude it.

> Block Storage : add cache interface
> -----------------------------------
>
>                 Key: HDFS-11361
>                 URL: https://issues.apache.org/jira/browse/HDFS-11361
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>         Attachments: HDFS-11361-HDFS-7240.001.patch, HDFS-11361-HDFS-7240.002.patch,
HDFS-11361-HDFS-7240.003.patch, HDFS-11361-HDFS-7240.004.patch, HDFS-11361-HDFS-7240.005.patch,
HDFS-11361-HDFS-7240.006.patch, HDFS-11361-HDFS-7240.007.patch
>
>
> This JIRA includes two major pieces: 1. the interface exposed to upper layer operating
system that mounts the file system; and 2. the interface exposed to lower layer container
storage layer.
> On one hand, to make CBlock mountable and accessible for a POSIX OS, we need to implement
file system protocol. We chose to do this by running cblock with jSCSI (http://jscsi.org/)
which is a java implementation of iSCSI protocol. More specifically, CBlock volume will exposed
as an java-based iSCSI target, and any machine that has iSCSI installed will be able to talk
to CBlock volume and mounted locally just as any disks. This is JIRA make a starting point
by introducing jSCSI and implementing its {{IStorageModule}}. This will be registered to jSCSI
server in future JIRA. 
> One the other hand, to be able to have the CBlock talk to container layer with better
performance, CBlock should be able to cache data locally. More specifically, clients' read/write
should be performed on the locally disk cache, while threads are pushing and retrieving data
in backend. This JIRA takes the first step by defining interfaces for the local cache. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message