oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cayanan, Michael D (388J)" <michael.d.caya...@jpl.nasa.gov>
Subject Re: PGE Question
Date Sat, 03 Mar 2012 09:10:31 GMT
Hey Brian,

Ya actually you're right. After thinking about this more, I ended up doing what you mention
below. Only I used the workflow instance id in the filemgr product metadata instead.

It's much cleaner going this route (adding the job_id or workflow instance id to the flilemgr)
instead of adding the filename to the workflow metadata.


From: holenoter <holenoter@mac.com<mailto:holenoter@mac.com>>
Reply-To: "user@oodt.apache.org<mailto:user@oodt.apache.org>" <user@oodt.apache.org<mailto:user@oodt.apache.org>>
Date: Fri, 2 Mar 2012 13:23:51 -0800
To: "user@oodt.apache.org<mailto:user@oodt.apache.org>" <user@oodt.apache.org<mailto:user@oodt.apache.org>>
Subject: Re: PGE Question

hey mike,

why do you need the filename in the workflow metadata?... you can add the job_id to your filemgr
product metadata and then you can just query the filemgr based on job_id to find out which
files where created for that job.


On Mar 02, 2012, at 12:36 PM, "Cayanan, Michael D (388J)" <michael.d.cayanan@jpl.nasa.gov<mailto:michael.d.cayanan@jpl.nasa.gov>>


In my PGE, I specify my output like the following:


           <dir path="[ProductLocation]" createBeforeExe="true">

              <files regExp="SMAP_L0B_RADAR_SPS.*\.h5" metFileWriterClass="[MetFileWriter]"
args="[ConfigMetoutFile]" />

              <files name="[PGETask_Name]_RunConfig_[ProductionDateTime].xml" metFileWriterClass="[MetFileWriter]"
args="[RunConfigMetoutFile]" />



After ingestion of this output product, I'd like to save the filename in my workflow metadata.
How would I do this?

I tried creating a PostIngestSuccess action, but found out that whatever metadata saving you
want to do on the "crawler" side doesn't get passed back to the workflow metadata.

I suppose I could update the workflow metadata by creating a PostIngestSuccess action and
using the workflow manager client API to do this. However, when I look at this class, I see
the following method,

updateMetadataForWorkflow(String workflowInstId, Metadata metadata)

where it requires the workflow instance ID as a parameter. Is there a way to capture the workflow
instance ID into the workflow metadata so that I can leverage this method to update my metadata?



View raw message