oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: PGE Question
Date Sat, 03 Mar 2012 18:46:01 GMT
+1, that makes sense.


On Mar 3, 2012, at 1:10 AM, Cayanan, Michael D (388J) wrote:

> Hey Brian,
> Ya actually you're right. After thinking about this more, I ended up doing what you mention
below. Only I used the workflow instance id in the filemgr product metadata instead.
> It's much cleaner going this route (adding the job_id or workflow instance id to the
flilemgr) instead of adding the filename to the workflow metadata.
> -Mike 
> From: holenoter <holenoter@mac.com>
> Reply-To: "user@oodt.apache.org" <user@oodt.apache.org>
> Date: Fri, 2 Mar 2012 13:23:51 -0800
> To: "user@oodt.apache.org" <user@oodt.apache.org>
> Subject: Re: PGE Question
> hey mike,
> why do you need the filename in the workflow metadata?... you can add the job_id to your
filemgr product metadata and then you can just query the filemgr based on job_id to find out
which files where created for that job.
> -brian
> On Mar 02, 2012, at 12:36 PM, "Cayanan, Michael D (388J)" <michael.d.cayanan@jpl.nasa.gov>
>> Hi,
>> In my PGE, I specify my output like the following:
>> 	<output>
>>            <dir path="[ProductLocation]" createBeforeExe="true">
>>               <files regExp="SMAP_L0B_RADAR_SPS.*\.h5" metFileWriterClass="[MetFileWriter]"
args="[ConfigMetoutFile]" />
>>               <files name="[PGETask_Name]_RunConfig_[ProductionDateTime].xml"
metFileWriterClass="[MetFileWriter]" args="[RunConfigMetoutFile]" />
>> 	   </dir>
>> 	</output>
>> After ingestion of this output product, I'd like to save the filename in my workflow
metadata. How would I do this?
>> I tried creating a PostIngestSuccess action, but found out that whatever metadata
saving you want to do on the "crawler" side doesn't get passed back to the workflow metadata.
>> I suppose I could update the workflow metadata by creating a PostIngestSuccess action
and using the workflow manager client API to do this. However, when I look at this class,
I see the following method,     
>> updateMetadataForWorkflow(String workflowInstId, Metadata metadata)
>> where it requires the workflow instance ID as a parameter. Is there a way to capture
the workflow instance ID into the workflow metadata so that I can leverage this method to
update my metadata?
>> Thanks,
>> Mike

Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA

View raw message