hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11361) Block Storage : add cache interface
Date Wed, 22 Mar 2017 21:21:41 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937160#comment-15937160
] 

Anu Engineer commented on HDFS-11361:
-------------------------------------

[~vagarychen] Sorry, I am taking my +1 back. I was trying to commit this change, but looks
like we violate some of the dependency rules. This was probably working because of the hack
that I did in HDFS-11496. That was fixed by [~szetszwo] yesterday evening. So the Jenkins
run was before that was reverted.

{code}
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.4:enforce
(enforce-banned-dependencies) on project hadoop-client-check-test-invariants: Some Enforcer
rules have failed. Look above for specific messages explaining why the rule failed. ->
[Help 1]
{code}

Looks like the changes in pom.xml is causing this issue. [~vagarychen] Could you please pull
the top of the tree of HDFS-7240 and you are able to compile the tree with shading on ? 

Here is the command that I am using *mvn clean install -DskipTests=true -Dmaven.javadoc.skip=true*.
I verified that I am able to compile without issues without this patch applied.


> Block Storage : add cache interface
> -----------------------------------
>
>                 Key: HDFS-11361
>                 URL: https://issues.apache.org/jira/browse/HDFS-11361
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>         Attachments: HDFS-11361-HDFS-7240.001.patch, HDFS-11361-HDFS-7240.002.patch,
HDFS-11361-HDFS-7240.003.patch, HDFS-11361-HDFS-7240.004.patch, HDFS-11361-HDFS-7240.005.patch,
HDFS-11361-HDFS-7240.006.patch, HDFS-11361-HDFS-7240.007.patch, HDFS-11361-HDFS-7240.008.patch
>
>
> This JIRA includes two major pieces: 1. the interface exposed to upper layer operating
system that mounts the file system; and 2. the interface exposed to lower layer container
storage layer.
> On one hand, to make CBlock mountable and accessible for a POSIX OS, we need to implement
file system protocol. We chose to do this by running cblock with jSCSI (http://jscsi.org/)
which is a java implementation of iSCSI protocol. More specifically, CBlock volume will exposed
as an java-based iSCSI target, and any machine that has iSCSI installed will be able to talk
to CBlock volume and mounted locally just as any disks. This is JIRA make a starting point
by introducing jSCSI and implementing its {{IStorageModule}}. This will be registered to jSCSI
server in future JIRA. 
> One the other hand, to be able to have the CBlock talk to container layer with better
performance, CBlock should be able to cache data locally. More specifically, clients' read/write
should be performed on the locally disk cache, while threads are pushing and retrieving data
in backend. This JIRA takes the first step by defining interfaces for the local cache. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message