Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C1868200C4C for ; Mon, 20 Mar 2017 23:35:48 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id C02F0160B71; Mon, 20 Mar 2017 22:35:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1177A160B76 for ; Mon, 20 Mar 2017 23:35:47 +0100 (CET) Received: (qmail 24143 invoked by uid 500); 20 Mar 2017 22:35:47 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 24054 invoked by uid 99); 20 Mar 2017 22:35:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Mar 2017 22:35:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 075961800B9 for ; Mon, 20 Mar 2017 22:35:46 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.651 X-Spam-Level: X-Spam-Status: No, score=0.651 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_NEUTRAL=0.652] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id tyORfCp79_TJ for ; Mon, 20 Mar 2017 22:35:44 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 373E35FCD7 for ; Mon, 20 Mar 2017 22:35:44 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id A15FAE0BB3 for ; Mon, 20 Mar 2017 22:35:42 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id E047E254E0 for ; Mon, 20 Mar 2017 22:35:41 +0000 (UTC) Date: Mon, 20 Mar 2017 22:35:41 +0000 (UTC) From: "Anu Engineer (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-11361) Block Storage : add cache interface MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 20 Mar 2017 22:35:48 -0000 [ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15933737#comment-15933737 ] Anu Engineer commented on HDFS-11361: ------------------------------------- [~vagarychen] Thanks for contributing this patch. From code reading it looks quite good. But can we add some unit tests ? > Block Storage : add cache interface > ----------------------------------- > > Key: HDFS-11361 > URL: https://issues.apache.org/jira/browse/HDFS-11361 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs > Reporter: Chen Liang > Assignee: Chen Liang > Attachments: HDFS-11361-HDFS-7240.001.patch, HDFS-11361-HDFS-7240.002.patch, HDFS-11361-HDFS-7240.003.patch > > > This JIRA includes two major pieces: 1. the interface exposed to upper layer operating system that mounts the file system; and 2. the interface exposed to lower layer container storage layer. > On one hand, to make CBlock mountable and accessible for a POSIX OS, we need to implement file system protocol. We chose to do this by running cblock with jSCSI (http://jscsi.org/) which is a java implementation of iSCSI protocol. More specifically, CBlock volume will exposed as an java-based iSCSI target, and any machine that has iSCSI installed will be able to talk to CBlock volume and mounted locally just as any disks. This is JIRA make a starting point by introducing jSCSI and implementing its {{IStorageModule}}. This will be registered to jSCSI server in future JIRA. > One the other hand, to be able to have the CBlock talk to container layer with better performance, CBlock should be able to cache data locally. More specifically, clients' read/write should be performed on the locally disk cache, while threads are pushing and retrieving data in backend. This JIRA takes the first step by defining interfaces for the local cache. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org