Return-Path: X-Original-To: apmail-oodt-dev-archive@www.apache.org Delivered-To: apmail-oodt-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3C97411F00 for ; Wed, 23 Apr 2014 17:40:05 +0000 (UTC) Received: (qmail 32689 invoked by uid 500); 23 Apr 2014 17:40:04 -0000 Delivered-To: apmail-oodt-dev-archive@oodt.apache.org Received: (qmail 32590 invoked by uid 500); 23 Apr 2014 17:40:03 -0000 Mailing-List: contact user-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@oodt.apache.org Delivered-To: mailing list user@oodt.apache.org Received: (qmail 32577 invoked by uid 99); 23 Apr 2014 17:40:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Apr 2014 17:40:03 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of chris.mattmann@gmail.com designates 209.85.220.45 as permitted sender) Received: from [209.85.220.45] (HELO mail-pa0-f45.google.com) (209.85.220.45) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Apr 2014 17:39:56 +0000 Received: by mail-pa0-f45.google.com with SMTP id kq14so336688pab.18 for ; Wed, 23 Apr 2014 10:39:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=user-agent:date:subject:from:to:message-id:thread-topic:references :in-reply-to:mime-version:content-type:content-transfer-encoding; bh=Lgn946C2qbvmAfKxHMUM4pmzxSON8XN3ogUMW6eIAuk=; b=f9eJ7LR/GZfeo61rC0MH4unN5knKQTkhHoFalF4QlCBIAPxPIx5Yt/PmrBPzt9Mzqc 9LLENHYIsCF1lje5M+kSbIZTbjOlyy7Kv24tuNwjWxfCP2XsdTR3dkykB97QSdU2H2IT /MimRwJpfDoUHJN1m6PSJOAFQwRMmy+T/4D/CgtjDM5alG2lM+TkvfESBFQSqXg4hw5T vFPQn25tjCXf+L9h44TYgmpEf5B1QwqDyq26UjKEc7txDz4FI8D5f8zeYtCgxiDeG39B wGEVQ1SHd/ZS9UE5VXo/WKjPzhAOXDH+LbaFirgso5mkAbZO+eKlW7JkEKDovfmWljCz SVfQ== X-Received: by 10.69.26.103 with SMTP id ix7mr57208806pbd.41.1398274775242; Wed, 23 Apr 2014 10:39:35 -0700 (PDT) Received: from [137.79.198.67] ([137.79.198.67]) by mx.google.com with ESMTPSA id vf7sm3815630pbc.5.2014.04.23.10.39.26 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Wed, 23 Apr 2014 10:39:34 -0700 (PDT) User-Agent: Microsoft-MacOutlook/14.4.1.140326 Date: Wed, 23 Apr 2014 10:39:11 -0700 Subject: Re: CAS maturity From: Chris Mattmann To: Message-ID: Thread-Topic: CAS maturity References: In-Reply-To: Mime-version: 1.0 Content-type: text/plain; charset="US-ASCII" Content-transfer-encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Dear Chadi, Thanks for your question! Yes, the Apache OODT CAS currently deals with large amounts of data, even up to petabytes (many 100s of TB), and the reality is though it's not necessarily the CAS that's doing the only heavy lifting in those environments for the data management pieces. CAS works side by side with distributed file systems (HDFS, NFS, Lustre, Gluster, etc.), along with replicated databases and catalogs and search engines (RDBMS, Solr, Lucene, Cassandra, HBase, HIVE, etc.) to manage Big Data while inducing very limited storage and computational overhead beyond the ingestion, metadata extraction, data movement and other step-by-step orchestration that it does. I would be very happy to discuss a specific use case or concern you have and thank you for considering using CAS! Cheers, Chris ------------------------ Chris Mattmann chris.mattmann@gmail.com -----Original Message----- From: chadi jaber Reply-To: Date: Tuesday, April 22, 2014 2:00 PM To: "user@oodt.apache.org" Subject: CAS maturity >Hello >I am willing to use the CAS component to implement a file Archiving >facility + versioning. the OODT component seems to have all the features >i need. But i have still concerns about it ability to cope with big data >amounts (reaching petabytes). Can I have some feedback about OODT Cas Use >with this kind of amounts? is it enough mature to be used in a real life >project ? >Sorry if my questions are too straightforward :) but the stakes are >important for me. > >Thanks in advance for your help. >Chadi >