From yarn-issues-return-153853-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Mon Sep 24 18:04:06 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id BD893180675 for ; Mon, 24 Sep 2018 18:04:05 +0200 (CEST) Received: (qmail 13507 invoked by uid 500); 24 Sep 2018 16:04:04 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 13190 invoked by uid 99); 24 Sep 2018 16:04:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Sep 2018 16:04:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 7057BC0158 for ; Mon, 24 Sep 2018 16:04:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -110.301 X-Spam-Level: X-Spam-Status: No, score=-110.301 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 39Ax-8LaOPqx for ; Mon, 24 Sep 2018 16:04:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 88DC55F5A3 for ; Mon, 24 Sep 2018 16:04:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 6F3FAE0D9F for ; Mon, 24 Sep 2018 16:04:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id AD77523FB2 for ; Mon, 24 Sep 2018 16:04:00 +0000 (UTC) Date: Mon, 24 Sep 2018 16:04:00 +0000 (UTC) From: "Eric Yang (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626064#comment-16626064 ] Eric Yang commented on YARN-8811: --------------------------------- [~cheersyang] {quote}For the comment about object store user API key information, I am not sure about this point, could you please elaborate.{quote} In [Hadoop AWS Integration document|https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html], we need to specify fs.s3a.access.key and fs.s3a.secret.key to connect to aws account. The same principal applies to swift fs, and other object store. Therefore, the CSI specification should include ability to pass the key information to connect to object store. In the current specification, it is also missing source storage information. Propagation options are required to make sure multiple mount of the same source storage system can be shared or exclusive mount. Without this defined, it might be troublesome for source storage system to decide the locking mechanism. > Support Container Storage Interface (CSI) in YARN > ------------------------------------------------- > > Key: YARN-8811 > URL: https://issues.apache.org/jira/browse/YARN-8811 > Project: Hadoop YARN > Issue Type: New Feature > Reporter: Weiwei Yang > Assignee: Weiwei Yang > Priority: Major > Attachments: Support Container Storage Interface(CSI) in YARN_design doc_20180921.pdf > > > The Container Storage Interface (CSI) is a vendor neutral interface to bridge Container Orchestrators and Storage Providers. With the adoption of CSI in YARN, it will be easier to integrate 3rd party storage systems, and provide the ability to attach persistent volumes for stateful applications. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-issues-help@hadoop.apache.org