crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Wills <jwi...@cloudera.com>
Subject Re: Materialize running the pipeline and not giving stage result.
Date Fri, 16 May 2014 21:04:50 GMT
Which Pipeline type are you running? MRPipeline?


On Fri, May 16, 2014 at 12:41 PM, anuj ojha <anujojha5@gmail.com> wrote:

> Hello All,
>         I am doing the following in my pipeline:
> {
> some processing.
> ........
> pcollections.materialize();
>
> final PipelineResult pipelineResult = pipeline.run();
>
>
> final List<StageResult> stageResults = pipelineResult.getStageResults();
>
>
> }
>
>
> I am trying to access stageresult and I am getting it as null. I can't
> avoid calling materialize as I use the data which I get from materializing
> pcollection in further processing. Is there another way to achieve what I
> am doing above?
>



-- 
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message