crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jinal Shah <jinalshah2...@gmail.com>
Subject Re: Materialize running the pipeline and not giving stage result.
Date Fri, 16 May 2014 23:02:14 GMT
Yes, MRPipeline.
On May 16, 2014 5:29 PM, "Josh Wills" <jwills@cloudera.com> wrote:

> Which Pipeline type are you running? MRPipeline?
>
>
> On Fri, May 16, 2014 at 12:41 PM, anuj ojha <anujojha5@gmail.com> wrote:
>
> > Hello All,
> >         I am doing the following in my pipeline:
> > {
> > some processing.
> > ........
> > pcollections.materialize();
> >
> > final PipelineResult pipelineResult = pipeline.run();
> >
> >
> > final List<StageResult> stageResults = pipelineResult.getStageResults();
> >
> >
> > }
> >
> >
> > I am trying to access stageresult and I am getting it as null. I can't
> > avoid calling materialize as I use the data which I get from
> materializing
> > pcollection in further processing. Is there another way to achieve what I
> > am doing above?
> >
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message