Return-Path: Delivered-To: apmail-lucene-hadoop-user-archive@locus.apache.org Received: (qmail 17548 invoked from network); 26 Apr 2007 22:17:58 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 26 Apr 2007 22:17:58 -0000 Received: (qmail 96699 invoked by uid 500); 26 Apr 2007 22:18:03 -0000 Delivered-To: apmail-lucene-hadoop-user-archive@lucene.apache.org Received: (qmail 96679 invoked by uid 500); 26 Apr 2007 22:18:03 -0000 Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-user@lucene.apache.org Delivered-To: mailing list hadoop-user@lucene.apache.org Received: (qmail 96670 invoked by uid 99); 26 Apr 2007 22:18:03 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Apr 2007 15:18:03 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: neutral (herse.apache.org: local policy) Received: from [64.233.166.180] (HELO py-out-1112.google.com) (64.233.166.180) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Apr 2007 15:17:56 -0700 Received: by py-out-1112.google.com with SMTP id a25so697537pyi for ; Thu, 26 Apr 2007 15:17:34 -0700 (PDT) Received: by 10.35.99.17 with SMTP id b17mr4004430pym.1177625854507; Thu, 26 Apr 2007 15:17:34 -0700 (PDT) Received: from circe.local ( [218.214.209.234]) by mx.google.com with ESMTP id w67sm645738pyg.2007.04.26.15.17.33; Thu, 26 Apr 2007 15:17:33 -0700 (PDT) Message-ID: <463124F4.7080406@holsman.net> Date: Fri, 27 Apr 2007 08:17:24 +1000 From: Ian Holsman User-Agent: Thunderbird 2.0.0.0 (Macintosh/20070326) MIME-Version: 1.0 To: hadoop-user@lucene.apache.org Subject: Re: Pig | Yahoo! Research References: <46310736.2080100@apache.org> <1177625099.5807.0.camel@vermin.localdomain> In-Reply-To: <1177625099.5807.0.camel@vermin.localdomain> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Jim Kellerman wrote: > Can someone comment on how Pig compares with Bigtable? > > On Thu, 2007-04-26 at 13:10 -0700, Doug Cutting wrote: > >> FYI >> >> http://research.yahoo.com/project/pig >> >> Doug >> my understanding is bigtable/hbase stores the data mapreduce/hadoop manipulates/creates the data to be stored in bigtable via functions, and controls the distribution sawzall/pig is a query language to extract information from it. I think it would use create functions for mapreduce/hadoop to run. regards Ian