Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 45335117B3 for ; Fri, 23 May 2014 21:39:50 +0000 (UTC) Received: (qmail 76404 invoked by uid 500); 23 May 2014 21:39:50 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 76364 invoked by uid 500); 23 May 2014 21:39:50 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 76356 invoked by uid 99); 23 May 2014 21:39:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 May 2014 21:39:50 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of anujojha5@gmail.com designates 209.85.214.172 as permitted sender) Received: from [209.85.214.172] (HELO mail-ob0-f172.google.com) (209.85.214.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 May 2014 21:39:45 +0000 Received: by mail-ob0-f172.google.com with SMTP id wp18so5956667obc.17 for ; Fri, 23 May 2014 14:39:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:references:from:content-type:in-reply-to:message-id:date:to :content-transfer-encoding:mime-version; bh=QU2SALKDAYs+/dag4MLcWP0lNhS55+NuRYAwf2c8Z7E=; b=F+w687qae3EAPVxo/cYT74AMgYKHp2ZQCjATrcRUKrIhIxdDDyLI64eVgJAdcVJFFl v6OvXLa/9SGGQCXPQJr03353LQbuyBxzM0FgVgzCTpe1KnqZFKOVHExeXOFyBbAxcHLC FTHMBwNPVpKjWJF7ri7gRh7bFG6Td5NhI4nx5wVzPRU8+PLEQeMVw8VrAufPRAr0eK9Q TsJgkDj54/HL67ABvFjslUnkl/qOtRaNzg2JQtSJ0HYL5XkJBstvoe/ytpIHbA5Qhl2N Sx9YXoigLal/AQGBOaSlpi1FwdifSApPjrg0aWRpJ6NV44/mSaDfS/ox42HIMX15Jk+8 bhug== X-Received: by 10.60.45.130 with SMTP id n2mr8208516oem.12.1400881164214; Fri, 23 May 2014 14:39:24 -0700 (PDT) Received: from [192.168.2.55] ([159.140.254.107]) by mx.google.com with ESMTPSA id rt4sm7576440obb.12.2014.05.23.14.39.23 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 23 May 2014 14:39:23 -0700 (PDT) Subject: Re: Materialize running the pipeline and not giving stage result. References: From: Anujojha5 Content-Type: text/plain; charset=us-ascii X-Mailer: iPhone Mail (11D169) In-Reply-To: Message-Id: <80A13D0C-B5F5-4EB9-B504-588711099322@gmail.com> Date: Fri, 23 May 2014 16:39:16 -0500 To: "dev@crunch.apache.org" Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) X-Virus-Checked: Checked by ClamAV on apache.org Thanks a lot Micah. Sent from my iPhone > On May 22, 2014, at 2:52 PM, Micah Whitacre wrote: >=20 > I logged CRUNCH-400[1] to track this. >=20 > [1] - https://issues.apache.org/jira/browse/CRUNCH-400 >=20 >=20 >> On Fri, May 16, 2014 at 6:02 PM, Jinal Shah wro= te: >>=20 >> Yes, MRPipeline. >>> On May 16, 2014 5:29 PM, "Josh Wills" wrote: >>>=20 >>> Which Pipeline type are you running? MRPipeline? >>>=20 >>>=20 >>>> On Fri, May 16, 2014 at 12:41 PM, anuj ojha wrote= : >>>>=20 >>>> Hello All, >>>> I am doing the following in my pipeline: >>>> { >>>> some processing. >>>> ........ >>>> pcollections.materialize(); >>>>=20 >>>> final PipelineResult pipelineResult =3D pipeline.run(); >>>>=20 >>>>=20 >>>> final List stageResults =3D >> pipelineResult.getStageResults(); >>>>=20 >>>>=20 >>>> } >>>>=20 >>>>=20 >>>> I am trying to access stageresult and I am getting it as null. I can't >>>> avoid calling materialize as I use the data which I get from >>> materializing >>>> pcollection in further processing. Is there another way to achieve >> what I >>>> am doing above? >>>=20 >>>=20 >>>=20 >>> -- >>> Director of Data Science >>> Cloudera >>> Twitter: @josh_wills >>=20