crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Wills <>
Subject Re: Materialization vs Intermediate outputs
Date Mon, 10 Feb 2014 19:54:35 GMT
I may be missing something in the code, but it's possible we're just
getting lucky, i.e., Crunch is choosing to serialize an intermediate output
that does not contain null values (or is a PCollection w/a PType that can
handle nulls.)

On Mon, Feb 10, 2014 at 11:02 AM, vinay koduri <>wrote:

> Thanks for the reply.
> May be I am missing something here, but  If crunch does not convert the
> PTable to PCollection, how is it able to  successfully serialize the
> intermediate PTable outputs, that could have null values, but  fails to
> materialize when asked explicitly?
> Vinay.

View raw message