Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 4F1CE200C05 for ; Mon, 9 Jan 2017 01:24:02 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 4DAD0160B45; Mon, 9 Jan 2017 00:24:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6AC2F160B36 for ; Mon, 9 Jan 2017 01:24:01 +0100 (CET) Received: (qmail 88524 invoked by uid 500); 9 Jan 2017 00:23:58 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 88156 invoked by uid 99); 9 Jan 2017 00:23:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jan 2017 00:23:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 885E12C1F5A for ; Mon, 9 Jan 2017 00:23:58 +0000 (UTC) Date: Mon, 9 Jan 2017 00:23:58 +0000 (UTC) From: "Mingliang Liu (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HADOOP-13960) Initialize DynamoDBMetadataStore without associated S3AFileSystem MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 09 Jan 2017 00:24:02 -0000 Mingliang Liu created HADOOP-13960: -------------------------------------- Summary: Initialize DynamoDBMetadataStore without associated S3AFileSystem Key: HADOOP-13960 URL: https://issues.apache.org/jira/browse/HADOOP-13960 Project: Hadoop Common Issue Type: Sub-task Components: fs/s3 Reporter: Mingliang Liu Assignee: Mingliang Liu Per the discussion in [HADOOP-13650], it's helpful to initialize a DynamoDBMetadataStore object without S3AFileSystem. In the current code, we can achieve this via {{DynamoDBMetadataStore#initialize(Configuration)}}. However, users still have to provide the associated S3AFileSystem URI in the configuration, by means of either setting the {{fs.defaultFS}} in configuration file or {{-fs s3://bucket}} command line parameter. Setting the default FileSystem in configuration seems not necessary as the command line is to manipulate metadata store, e.g. command line tools on an existing HDFS cluster. This JIRA is to track the effort of initializing a DynamoDBMetadataStore without associating any S3 buckets, so that S3AFileSystem is not needed. Users have to specify in configuration the DynamoDB endpoints (for region) and table name along with credentials, AWS client settings. See [~eddyxu] and [~liuml07]'s comments in [HADOOP-13650] for more details. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org