Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0B3F710216 for ; Wed, 7 Aug 2013 13:05:38 +0000 (UTC) Received: (qmail 95811 invoked by uid 500); 7 Aug 2013 13:05:36 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 95745 invoked by uid 500); 7 Aug 2013 13:05:34 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 95730 invoked by uid 99); 7 Aug 2013 13:05:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Aug 2013 13:05:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mkwhit@gmail.com designates 209.85.215.170 as permitted sender) Received: from [209.85.215.170] (HELO mail-ea0-f170.google.com) (209.85.215.170) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Aug 2013 13:05:26 +0000 Received: by mail-ea0-f170.google.com with SMTP id h14so857344eak.1 for ; Wed, 07 Aug 2013 06:05:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=tlWExhNlE/nrcnlrrD4HwWRFjDUmquqwMu3Si2ySptc=; b=boFpZY889YgQolVihKlPrSbTHQGWbbKXTJR/a2kZb6nG10Bz5/xBzQIZGX3ht9qYgg 5tHNobxlBIi2CjvQx2d3K5kBJtNUSWZRTwN1L7/HF1MIQmsYHFiIOtxw1R8x4ZTHET/Q DSIKf9Oga7f9rXyhr0sYaPRHc5ZCBfUV4G3XMIQv7+vMJLiQ+n0VNii8JXZ2mqkjP17g YpXf2HQWTotM/poWsXJh6tMaTDm6fXyQMJNGo0euvnVg7UwEOw1Et+uU2Bm4yEX0C0oV PpQ4aWfx9dWwsllu7qnu23h/AMDXEzFgKJAjq61PqkeghueMohFnykIyrKHby7TzYUVe iugw== X-Received: by 10.15.111.136 with SMTP id cj8mr2980233eeb.91.1375880705666; Wed, 07 Aug 2013 06:05:05 -0700 (PDT) MIME-Version: 1.0 Received: by 10.14.93.133 with HTTP; Wed, 7 Aug 2013 06:04:45 -0700 (PDT) In-Reply-To: References: From: Micah Whitacre Date: Wed, 7 Aug 2013 08:04:45 -0500 Message-ID: Subject: Re: MultipleOutputs in Crunch To: dev@crunch.apache.org Content-Type: multipart/alternative; boundary=089e0160c19cb71fec04e35b30cb X-Virus-Checked: Checked by ClamAV on apache.org --089e0160c19cb71fec04e35b30cb Content-Type: text/plain; charset=ISO-8859-1 I believe you could accomplish this but creating PCollections for each of the key/values you want to persist and then writing[1] the PCollections out to whichever directories makes the most sense. [1] - http://crunch.apache.org/apidocs/0.7.0/org/apache/crunch/Pipeline.html#write(org.apache.crunch.PCollection, org.apache.crunch.Target) On Wed, Aug 7, 2013 at 3:31 AM, Mridul Das wrote: > Hi, > MultipleOutputs enable us to generate custom file names base on > keys/values. > How do we achieve this in Crunch? > > Regards, > Mridul > --089e0160c19cb71fec04e35b30cb--