From dev-return-50228-apmail-cloudstack-dev-archive=cloudstack.apache.org@cloudstack.apache.org Wed Jan 15 18:55:18 2014 Return-Path: X-Original-To: apmail-cloudstack-dev-archive@www.apache.org Delivered-To: apmail-cloudstack-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5E48910CA7 for ; Wed, 15 Jan 2014 18:55:18 +0000 (UTC) Received: (qmail 3411 invoked by uid 500); 15 Jan 2014 18:55:17 -0000 Delivered-To: apmail-cloudstack-dev-archive@cloudstack.apache.org Received: (qmail 3348 invoked by uid 500); 15 Jan 2014 18:55:17 -0000 Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list dev@cloudstack.apache.org Received: (qmail 3340 invoked by uid 99); 15 Jan 2014 18:55:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jan 2014 18:55:16 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of min.chen@citrix.com designates 66.165.176.63 as permitted sender) Received: from [66.165.176.63] (HELO SMTP02.CITRIX.COM) (66.165.176.63) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jan 2014 18:55:11 +0000 X-IronPort-AV: E=Sophos;i="4.95,664,1384300800"; d="scan'208,217";a="91089843" Received: from sjcpex01cl03.citrite.net ([10.216.14.145]) by FTLPIPO02.CITRIX.COM with ESMTP/TLS/AES128-SHA; 15 Jan 2014 18:54:48 +0000 Received: from SJCPEX01CL01.citrite.net ([169.254.1.22]) by SJCPEX01CL03.citrite.net ([10.216.14.145]) with mapi id 14.02.0342.004; Wed, 15 Jan 2014 10:54:48 -0800 From: Min Chen To: John Burwell CC: "dev@cloudstack.apache.org" , Thomas O'Dowd Subject: Re: S3 API to get S3 bucket usage data? Thread-Topic: S3 API to get S3 bucket usage data? Thread-Index: AQHPEh9k+6OK6DMKX0C0qKI6+VoDupqGpN4A//99ZwA= Date: Wed, 15 Jan 2014 18:54:47 +0000 Message-ID: In-Reply-To: <50FE4D6A-BEA4-4B8B-9D98-584E3F37CBFF@basho.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.3.6.130613 x-originating-ip: [10.215.3.2] Content-Type: multipart/alternative; boundary="_000_CEFC182B52712minchencitrixcom_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_CEFC182B52712minchencitrixcom_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Thanks a lot for your clarification, John. This issue was raised by some of= CloudStack S3 customers, and they are questioning why we didn't display th= e usage information for their S3 secondary storage in CloudStack Dashboard = UI, which includes both size of objects in the bucket and physical space in= the cluster a bucket occupies. I totally agree with you that these will be= vendor specific, and we should not bother to display them on CloudStack UI= . Thanks -min From: John Burwell > Date: Wednesday, January 15, 2014 10:42 AM To: Min Chen > Cc: "dev@cloudstack.apache.org" >, Thomas O'Dowd > Subject: Re: S3 API to get S3 bucket usage data? Min, Such a notion is completely anachronistic to a client object store due to t= he abstraction =97 it is solely an operational. Hence, you won=92t find sp= ace information available in object store client APIs. The first question is what space information are you seeking? The logical = size of the objects in the bucket or how much physical space in the cluster= a bucket occupies? The first is simply a sum of all object sizes in the b= ucket. The second is very difficult to answer through the client interface= due to factors such as the intra-cluster replication factor for the bucket= , the use of mechanisms such as erasure encoding and compression, and the n= umber of data centers to which the object is replicated. For these reasons,= space information is typically only exposed via the operational monitoring= interfaces, and would likely need to be acquired through vendor specific d= rivers. Thanks, -John On Jan 15, 2014, at 1:27 PM, Min Chen > wrote: Hi there, Does anybody out there know if AWS S3 provides programmatical way to get bu= cket-level usage data? For example, used space or available space as we cur= rent show in CloudStack dashboard for NFS secondary storage. I googled arou= nd the web, and didn't find any S3 api to do that. Any comments will be app= reciated. Thanks -min --_000_CEFC182B52712minchencitrixcom_--