oodt-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: CAS PGE Question + Workflow Context Metadata
Date Sat, 24 Sep 2011 02:59:04 GMT
Sounds great, thanks Sheryl. And no I don't mind, go for it.

Cheers,
Chris

On Sep 23, 2011, at 7:23 PM, Sheryl John wrote:

> Hi Chris,
> 
> Yes, I'll file the issue.
> I won't be able to start on the patch right away. But if you don't mind the delay, I
would like to work on it.
> 
> Thanks,
> 
> On Fri, Sep 23, 2011 at 7:01 PM, Mattmann, Chris A (388J) <chris.a.mattmann@jpl.nasa.gov>
wrote:
> Hey Sheryl,
> 
> Thanks. Can you file an issue in JIRA requesting the addition of a workflow manager
> client method to return the workflow instance metadata from the cmd line?
> 
> If you've got the time or inclination to work on a patch, I'd love to help you shepherd
it
> in. Otherwise, I can work on it.
> 
> Cheers,
> Chris
> 
> On Sep 23, 2011, at 11:34 AM, Sheryl John wrote:
> 
> > Hi Rishi,
> >
> > The step-by-step CAS-PGE tutorial is great!
> >
> > I didn't know about the --metaData option till a few days back when Chris told me
that it adds the key-value pairs to the Workflow context metadata.
> >
> > Do you know how I can see or get this workflow metadata?
> > For the example in the tutorial, I want to check if the RunID that was sent as metaData
to the File Concatenator PGE was recorded for that workflow.
> >
> >
> > When I checked the XmlRpcWorkflowManagerClient.java [1], none of the command-line
options seem to return the workflow instance metadata, but I see a method 'public Metadata
getWorkflowInstanceMetadata(String wInstId)' and it's not being used yet.
> >
> >
> > [1]https://svn.apache.org/repos/asf/oodt/trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/XmlRpcWorkflowManagerClient.java
> >
> > Thanks,
> >
> > On Thu, Sep 22, 2011 at 5:09 PM, Verma, Rishi (317I) <Rishi.Verma@jpl.nasa.gov>
wrote:
> > Hi Mike,
> >
> > A good way to specify which types of files you would like to ingest is by using
the "regExp" attribute within the 'files' element of your PGEConfig.xml.
> >
> > You can specify files with a certain extension, or files that match a certain regular
expression within their file name.
> >
> > Here's an example:
> >
> > <files regExp=".*\.txt" metFileWriterClass="org.apache.oodt.pge.examples.fileconcatenator.writers.ConcactenatingFilenameExtractorWriter"
 args="[PGE_ROOT]/file_concatenator/extractors/concatenatingfilename.extractor.config.xml"/>
> >
> > You might want to look at a tutorial I wrote on how to create a simple PGE [1] located
within JIRA issue [2]. This tutorial includes a full sample PGEConfig.xml file with the example
above in context. I'm in the process of converting this to xdoc for the OODT site, but feel
free to try it out!
> >
> > [1] https://issues.apache.org/jira/secure/attachment/12489556/CAS-PGE_learn_by_example.docx
> > [2] https://issues.apache.org/jira/browse/OODT-217
> >
> > Thanks,
> > Rishi
> >
> > On Sep 22, 2011, at 4:45 PM, Cayanan, Michael D (388J) wrote:
> >
> >> Is there a mechanism in CAS PGE to tell the file manager to only ingest
> >> certain files? If so, how is this done? Is it through a "metout" file of
> >> some sort?
> >>
> >> We'd like to use this feature (if it exists) in SMAP.
> >>
> >> Thanks,
> >> Mike
> >
> >
> >
> >
> > --
> > -Sheryl
> 
> 
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> 
> 
> 
> 
> -- 
> -Sheryl


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Mime
View raw message