Return-Path: X-Original-To: apmail-oodt-dev-archive@www.apache.org Delivered-To: apmail-oodt-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5ED7D920A for ; Sat, 3 Mar 2012 09:11:01 +0000 (UTC) Received: (qmail 75759 invoked by uid 500); 3 Mar 2012 09:11:01 -0000 Delivered-To: apmail-oodt-dev-archive@oodt.apache.org Received: (qmail 75714 invoked by uid 500); 3 Mar 2012 09:11:01 -0000 Mailing-List: contact user-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@oodt.apache.org Delivered-To: mailing list user@oodt.apache.org Received: (qmail 75706 invoked by uid 99); 3 Mar 2012 09:11:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 03 Mar 2012 09:11:01 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [128.149.139.106] (HELO mail.jpl.nasa.gov) (128.149.139.106) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 03 Mar 2012 09:10:47 +0000 Received: from mail.jpl.nasa.gov (altvirehtstap02.jpl.nasa.gov [128.149.137.73]) by smtp.jpl.nasa.gov (Switch-3.4.3/Switch-3.4.3) with ESMTP id q239AOcL005156 (using TLSv1/SSLv3 with cipher RC4-MD5 (128 bits) verified NO) for ; Sat, 3 Mar 2012 01:10:24 -0800 Received: from ALTPHYEMBEVSP30.RES.AD.JPL ([128.149.137.84]) by ALTVIREHTSTAP02.RES.AD.JPL ([128.149.137.73]) with mapi; Sat, 3 Mar 2012 01:10:18 -0800 From: "Cayanan, Michael D (388J)" To: "user@oodt.apache.org" Date: Sat, 3 Mar 2012 01:10:31 -0800 Subject: Re: PGE Question Thread-Topic: PGE Question Thread-Index: Acz5HXOJGY8ql326TWykaoMUR2wDEQ== Message-ID: In-Reply-To: <825199a2-9d03-c359-9212-b226569f6ac0@me.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.14.0.111121 acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CB771F76B36Fmichaelcayananjplnasagov_" MIME-Version: 1.0 X-Source-IP: altvirehtstap02.jpl.nasa.gov [128.149.137.73] X-Source-Sender: michael.d.cayanan@jpl.nasa.gov X-AUTH: Authorized X-Virus-Checked: Checked by ClamAV on apache.org --_000_CB771F76B36Fmichaelcayananjplnasagov_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hey Brian, Ya actually you're right. After thinking about this more, I ended up doing = what you mention below. Only I used the workflow instance id in the filemgr= product metadata instead. It's much cleaner going this route (adding the job_id or workflow instance = id to the flilemgr) instead of adding the filename to the workflow metadata= . -Mike From: holenoter > Reply-To: "user@oodt.apache.org" > Date: Fri, 2 Mar 2012 13:23:51 -0800 To: "user@oodt.apache.org" > Subject: Re: PGE Question hey mike, why do you need the filename in the workflow metadata?... you can add the j= ob_id to your filemgr product metadata and then you can just query the file= mgr based on job_id to find out which files where created for that job. -brian On Mar 02, 2012, at 12:36 PM, "Cayanan, Michael D (388J)" > wrote: Hi, In my PGE, I specify my output like the following: After ingestion of this output product, I'd like to save the filename in my= workflow metadata. How would I do this? I tried creating a PostIngestSuccess action, but found out that whatever me= tadata saving you want to do on the "crawler" side doesn't get passed back = to the workflow metadata. I suppose I could update the workflow metadata by creating a PostIngestSucc= ess action and using the workflow manager client API to do this. However, w= hen I look at this class, I see the following method, updateMetadataForWorkflow(String workflowInstId, Metadata metadata) where it requires the workflow instance ID as a parameter. Is there a way t= o capture the workflow instance ID into the workflow metadata so that I can= leverage this method to update my metadata? Thanks, Mike --_000_CB771F76B36Fmichaelcayananjplnasagov_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hey Brian,

Ya actually you're right. After thinking about this more, I end= ed up doing what you mention below. Only I used the workflow instance id in= the filemgr product metadata instead.

It's much c= leaner going this route (adding the job_id or workflow instance id to the f= lilemgr) instead of adding the filename to the workflow metadata.

-Mike

From: holenoter <holenoter@mac.com>
Reply-To: "user@oodt.apache.org" &l= t;user@oodt.apache.org>
<= span style=3D"font-weight:bold">Date: Fri, 2 Mar 2012 13:23:51 -080= 0
To: "user@oodt.apache.org" <user@oodt.apache.org>
Subject: Re: PGE Question

<= div style=3D"font-family: Helvetica, Arial, Verdana, sans-serif; ">hey mike= ,

=

-brian

On Mar 02, 2012, at 12:36 PM, "Cayanan, Michael D (388J)" = <michael.d.cayanan@jpl= .nasa.gov> wrote:

Hi,

In my PGE, I specify my output like the following:

<output>
<dir path=3D"[ProductLocat= ion]" = createBeforeE= xe=3D<= /span>"true"&= gt;
<= span style=3D"color: #009192" _mce_style=3D"color: #009192;"> = <files regExp=3D"SMAP_L0B_RADAR_SPS.*\.h5" metFileWriterClass=3D"[MetFi= leWriter]" args=3D"[ConfigMetoutFile]" />
= <files name=3D"[PGETask_Name]_RunConfig_[Produ= ctionDateTime].xml" metFileWriterClass=3D"[MetFileWriter]" args=3D"[RunConfigMetoutFile]" />
</dir>
=
</outpu= t><= /p>

After ingestion of this output product, I'd l= ike to save the filename in my workflow metadata. How would I do this?

I tried creating a PostIngestSuccess = action, but found out that whatever metadata saving you want to do on the "= crawler" side doesn't get passed back to the workflow metadata.
<= p style=3D"margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-l= eft: 0px; font: normal normal normal 11px/normal Monaco; " _mce_style=3D"fo= nt: normal normal normal 11px/normal Monaco; margin: 0px;">
I suppose I could update the workflow metada= ta by creating a PostIngestSuccess action and using the workflow manager cl= ient API to do this. However, when I look at this class, I see the followin= g method,

updateMetadataForWorkflow(String workflowInstId, Metadata= metadata)
<= font class=3D"Apple-style-span" face=3D"Calibri" size=3D"3">

where it requires the workflow instance = ID as a parameter. Is there a way to capture the workflow instance ID into = the workflow metadata so that I can leverage this method to update my metad= ata?
=
Thanks,
Mike

= --_000_CB771F76B36Fmichaelcayananjplnasagov_--