Return-Path: X-Original-To: apmail-cloudstack-dev-archive@www.apache.org Delivered-To: apmail-cloudstack-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 99D3410C43 for ; Thu, 6 Jun 2013 20:57:00 +0000 (UTC) Received: (qmail 30347 invoked by uid 500); 6 Jun 2013 20:57:00 -0000 Delivered-To: apmail-cloudstack-dev-archive@cloudstack.apache.org Received: (qmail 30295 invoked by uid 500); 6 Jun 2013 20:57:00 -0000 Mailing-List: contact dev-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cloudstack.apache.org Delivered-To: mailing list dev@cloudstack.apache.org Received: (qmail 30287 invoked by uid 99); 6 Jun 2013 20:57:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jun 2013 20:57:00 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of min.chen@citrix.com designates 66.165.176.63 as permitted sender) Received: from [66.165.176.63] (HELO SMTP02.CITRIX.COM) (66.165.176.63) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Jun 2013 20:56:54 +0000 X-IronPort-AV: E=Sophos;i="4.87,817,1363132800"; d="scan'208,217";a="28340554" Received: from sjcpex01cl03.citrite.net ([10.216.14.145]) by FTLPIPO02.CITRIX.COM with ESMTP/TLS/AES128-SHA; 06 Jun 2013 20:56:10 +0000 Received: from SJCPEX01CL01.citrite.net ([169.254.1.43]) by SJCPEX01CL03.citrite.net ([169.254.3.165]) with mapi id 14.02.0342.003; Thu, 6 Jun 2013 13:54:59 -0700 From: Min Chen To: "dev@cloudstack.apache.org" Subject: Re: Object based Secondary storage. Thread-Topic: Object based Secondary storage. Thread-Index: AQHOYc9+DZgqy53xg0mkcPBX+dynC5knS80AgAGNcoCAAFNTgA== Date: Thu, 6 Jun 2013 20:54:59 +0000 Message-ID: In-Reply-To: <1370509001.30069.382.camel@bertha> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.3.4.130416 x-originating-ip: [10.216.48.12] Content-Type: text/plain; charset="iso-8859-1" Content-ID: <635F68DD3F576B409E8F86EDE6E3BEFC@citrix.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Thanks Tom. Indeed I have a S3 question that need some advise from some S3 experts. To support upload object > 5G, I have used TransferManager.upload to upload object to S3, upload went fine and object are successfully put to S3. However, later on when I am using "s3cmd get " to retrieve this object, I always got this exception: "MD5 signatures do not match: computed=3DY, received=3D"X" It seems that Amazon S3 kept a different Md5 sum for the multi-part uploaded object. We have been using Riak CS for our S3 testing. If I changed to not using multi-part upload and directly invoking S3 putObject, I will not run into this issue. Do you have such experience before? -min On 6/6/13 1:56 AM, "Thomas O'Dowd" wrote: >Thanks Min. I've printed out the material and am reading new threads. >Can't comment much yet until I understand things a bit more. > >Meanwhile, feel free to hit me up with any S3 questions you have. I'm >looking forward to playing with the object_store branch and testing it >out. > >Tom. > >On Wed, 2013-06-05 at 16:14 +0000, Min Chen wrote: >> Welcome Tom. You can check out this FS >>=20 >>https://cwiki.apache.org/confluence/display/CLOUDSTACK/Storage+Backup+Obj >>ec >> t+Store+Plugin+Framework for secondary storage architectural work done >>in >> object_store branch.You may also check out the following recent threads >> regarding 3 major technical questions raised by community as well as our >> answers and clarification. >>=20 >>http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201306.mbox/%3C77 >>B3 >> 37AF224FD84CBF8401947098DD87036A76%40SJCPEX01CL01.citrite.net%3E >>=20 >>http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201306.mbox/%3CCD >>D2 >> 2955.3DDDC%25min.chen%40citrix.com%3E >>=20 >>http://mail-archives.apache.org/mod_mbox/cloudstack-dev/201306.mbox/%3CCD >>D2 >> 300D.3DE0C%25min.chen%40citrix.com%3E >>=20 >>=20 >> That branch is mainly worked on by Edison and me, and we are at PST >> timezone.=20 >>=20 >> Thanks >> -min >--=20 >Cloudian KK - http://www.cloudian.com/get-started.html >Fancy 100TB of full featured S3 Storage? >Checkout the Cloudian=AE Community Edition! >