oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: CAS PGE Question + Workflow Context Metadata
Date Sat, 24 Sep 2011 02:01:38 GMT
Hey Sheryl,

Thanks. Can you file an issue in JIRA requesting the addition of a workflow manager 
client method to return the workflow instance metadata from the cmd line?

If you've got the time or inclination to work on a patch, I'd love to help you shepherd it

in. Otherwise, I can work on it.

Cheers,
Chris

On Sep 23, 2011, at 11:34 AM, Sheryl John wrote:

> Hi Rishi,
> 
> The step-by-step CAS-PGE tutorial is great! 
> 
> I didn't know about the --metaData option till a few days back when Chris told me that
it adds the key-value pairs to the Workflow context metadata.
> 
> Do you know how I can see or get this workflow metadata?
> For the example in the tutorial, I want to check if the RunID that was sent as metaData
to the File Concatenator PGE was recorded for that workflow.
> 
> 
> When I checked the XmlRpcWorkflowManagerClient.java [1], none of the command-line options
seem to return the workflow instance metadata, but I see a method 'public Metadata getWorkflowInstanceMetadata(String
wInstId)' and it's not being used yet.
> 
> 
> [1]https://svn.apache.org/repos/asf/oodt/trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/XmlRpcWorkflowManagerClient.java
> 
> Thanks,
> 
> On Thu, Sep 22, 2011 at 5:09 PM, Verma, Rishi (317I) <Rishi.Verma@jpl.nasa.gov>
wrote:
> Hi Mike,
> 
> A good way to specify which types of files you would like to ingest is by using the "regExp"
attribute within the 'files' element of your PGEConfig.xml.
> 
> You can specify files with a certain extension, or files that match a certain regular
expression within their file name.
> 
> Here's an example:
> 
> <files regExp=".*\.txt" metFileWriterClass="org.apache.oodt.pge.examples.fileconcatenator.writers.ConcactenatingFilenameExtractorWriter"
 args="[PGE_ROOT]/file_concatenator/extractors/concatenatingfilename.extractor.config.xml"/>
> 
> You might want to look at a tutorial I wrote on how to create a simple PGE [1] located
within JIRA issue [2]. This tutorial includes a full sample PGEConfig.xml file with the example
above in context. I'm in the process of converting this to xdoc for the OODT site, but feel
free to try it out!
> 
> [1] https://issues.apache.org/jira/secure/attachment/12489556/CAS-PGE_learn_by_example.docx
> [2] https://issues.apache.org/jira/browse/OODT-217
> 
> Thanks,
> Rishi
> 
> On Sep 22, 2011, at 4:45 PM, Cayanan, Michael D (388J) wrote:
> 
>> Is there a mechanism in CAS PGE to tell the file manager to only ingest
>> certain files? If so, how is this done? Is it through a "metout" file of
>> some sort?
>> 
>> We'd like to use this feature (if it exists) in SMAP.
>> 
>> Thanks,
>> Mike
> 
> 
> 
> 
> -- 
> -Sheryl


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Mime
View raw message