crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vinay koduri <kvinaysrini...@gmail.com>
Subject Re: Materialization vs Intermediate outputs
Date Mon, 10 Feb 2014 22:29:41 GMT
Its becoming self-aware. :)

Thanks
Vinay Koduri


On Mon, Feb 10, 2014 at 1:54 PM, Josh Wills <josh.wills@gmail.com> wrote:

> I may be missing something in the code, but it's possible we're just
> getting lucky, i.e., Crunch is choosing to serialize an intermediate output
> that does not contain null values (or is a PCollection w/a PType that can
> handle nulls.)
>
>
> On Mon, Feb 10, 2014 at 11:02 AM, vinay koduri <kvinaysrinivas@gmail.com>wrote:
>
>> Thanks for the reply.
>>
>> May be I am missing something here, but  If crunch does not convert the
>> PTable to PCollection, how is it able to  successfully serialize the
>> intermediate PTable outputs, that could have null values, but  fails to
>> materialize when asked explicitly?
>>
>> Vinay.
>>
>
>

Mime
View raw message