crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Whitacre <mkw...@gmail.com>
Subject Re: MultipleOutputs in Crunch
Date Wed, 07 Aug 2013 13:04:45 GMT
I believe you could accomplish this but creating PCollections for each of
the key/values you want to persist and then writing[1] the PCollections out
to whichever directories makes the most sense.

[1] -
http://crunch.apache.org/apidocs/0.7.0/org/apache/crunch/Pipeline.html#write(org.apache.crunch.PCollection,
org.apache.crunch.Target)


On Wed, Aug 7, 2013 at 3:31 AM, Mridul Das <d.mridul@gmail.com> wrote:

> Hi,
>    MultipleOutputs enable us to generate custom file names base on
> keys/values.
>    How do we achieve this in Crunch?
>
> Regards,
> Mridul
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message