Return-Path: X-Original-To: apmail-pig-dev-archive@www.apache.org Delivered-To: apmail-pig-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DB9CA9024 for ; Wed, 4 Jul 2012 01:34:30 +0000 (UTC) Received: (qmail 40811 invoked by uid 500); 4 Jul 2012 01:34:30 -0000 Delivered-To: apmail-pig-dev-archive@pig.apache.org Received: (qmail 40781 invoked by uid 500); 4 Jul 2012 01:34:30 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 40773 invoked by uid 99); 4 Jul 2012 01:34:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Jul 2012 01:34:30 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jcoveney@gmail.com designates 209.85.214.177 as permitted sender) Received: from [209.85.214.177] (HELO mail-ob0-f177.google.com) (209.85.214.177) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Jul 2012 01:34:24 +0000 Received: by obbta17 with SMTP id ta17so15503470obb.22 for ; Tue, 03 Jul 2012 18:34:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=WGBDau0ETvLfWGamDlftBIJmhWPrCabNea+RsGM/CfE=; b=UpYKB41PCCin/CFFTy4lGn4IiKUglXW6bi+U/43fcn05FVMGeYRlLgrmrDA9g9SBe5 za1JIlNcUiI6QLi0qWtTDjA0/LToLWK0xk3wGIltRPFQ8xVd1SqC/V8cZBszCfgFdRjG fNYzkU0EdsPt3scX0cbvTfBu0ah4usfM3w/X2BHLreMGvjgVdB1al1XWfgAmd789tM7V +Zy3vNI0UfZPXXWDO8mE3ZucesPBHg9QQiEqK7vc8zwa8OGqs0r86ivv9SYKNgArXto5 WTA41W9/xY/K0i6gl87w229XXuJSeZFdDaRZdItI2aBMrIxhciCZj2ZEzPed+e8qQUXP ppYQ== MIME-Version: 1.0 Received: by 10.182.136.71 with SMTP id py7mr15508564obb.45.1341365643659; Tue, 03 Jul 2012 18:34:03 -0700 (PDT) Received: by 10.182.154.4 with HTTP; Tue, 3 Jul 2012 18:34:03 -0700 (PDT) In-Reply-To: References: <35065AA3-CB8F-49D6-82BA-994B05A3F2ED@gmail.com> Date: Tue, 3 Jul 2012 18:34:03 -0700 Message-ID: Subject: Re: Are there any explanations of the implementation of illustrate? From: Jonathan Coveney To: dev@pig.apache.org Content-Type: multipart/alternative; boundary=e89a8f5039cab44a2c04c3f70686 --e89a8f5039cab44a2c04c3f70686 Content-Type: text/plain; charset=UTF-8 Jie, that's perfect, thanks. This doc, specifically: http://i.stanford.edu/~olston/publications/sigmod09.pdf is exactly the detailed explanation I was looking for. 2012/7/3 Jie Li > Some document here: http://wiki.apache.org/pig/PigIllustrate > > I agree that more tests are needed for illustrate, otherwise it can be > easily broken without notice. > > Jie > > On Tue, Jul 3, 2012 at 12:45 PM, Jon Coveney wrote: > > I was curious at a level slightly higher than "dig through the code" how > illustrate is so fast, and how it deals with joins effectively. Are there > any resources on this (or does anyone at Hortonworks want to write a tech > oriented blog post? :) > > > --e89a8f5039cab44a2c04c3f70686--