oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Verma, Rishi (317I)" <Rishi.Ve...@jpl.nasa.gov>
Subject Re: CAS PGE Question + Workflow Context Metadata
Date Mon, 26 Sep 2011 19:54:49 GMT
Thanks Sheryl, and Chris for the clarification!

Rishi

On Sep 23, 2011, at 7:59 PM, Mattmann, Chris A (388J) wrote:

> Sounds great, thanks Sheryl. And no I don't mind, go for it.
> 
> Cheers,
> Chris
> 
> On Sep 23, 2011, at 7:23 PM, Sheryl John wrote:
> 
>> Hi Chris,
>> 
>> Yes, I'll file the issue.
>> I won't be able to start on the patch right away. But if you don't mind the delay,
I would like to work on it.
>> 
>> Thanks,
>> 
>> On Fri, Sep 23, 2011 at 7:01 PM, Mattmann, Chris A (388J) <chris.a.mattmann@jpl.nasa.gov>
wrote:
>> Hey Sheryl,
>> 
>> Thanks. Can you file an issue in JIRA requesting the addition of a workflow manager
>> client method to return the workflow instance metadata from the cmd line?
>> 
>> If you've got the time or inclination to work on a patch, I'd love to help you shepherd
it
>> in. Otherwise, I can work on it.
>> 
>> Cheers,
>> Chris
>> 
>> On Sep 23, 2011, at 11:34 AM, Sheryl John wrote:
>> 
>>> Hi Rishi,
>>> 
>>> The step-by-step CAS-PGE tutorial is great!
>>> 
>>> I didn't know about the --metaData option till a few days back when Chris told
me that it adds the key-value pairs to the Workflow context metadata.
>>> 
>>> Do you know how I can see or get this workflow metadata?
>>> For the example in the tutorial, I want to check if the RunID that was sent as
metaData to the File Concatenator PGE was recorded for that workflow.
>>> 
>>> 
>>> When I checked the XmlRpcWorkflowManagerClient.java [1], none of the command-line
options seem to return the workflow instance metadata, but I see a method 'public Metadata
getWorkflowInstanceMetadata(String wInstId)' and it's not being used yet.
>>> 
>>> 
>>> [1]https://svn.apache.org/repos/asf/oodt/trunk/workflow/src/main/java/org/apache/oodt/cas/workflow/system/XmlRpcWorkflowManagerClient.java
>>> 
>>> Thanks,
>>> 
>>> On Thu, Sep 22, 2011 at 5:09 PM, Verma, Rishi (317I) <Rishi.Verma@jpl.nasa.gov>
wrote:
>>> Hi Mike,
>>> 
>>> A good way to specify which types of files you would like to ingest is by using
the "regExp" attribute within the 'files' element of your PGEConfig.xml.
>>> 
>>> You can specify files with a certain extension, or files that match a certain
regular expression within their file name.
>>> 
>>> Here's an example:
>>> 
>>> <files regExp=".*\.txt" metFileWriterClass="org.apache.oodt.pge.examples.fileconcatenator.writers.ConcactenatingFilenameExtractorWriter"
 args="[PGE_ROOT]/file_concatenator/extractors/concatenatingfilename.extractor.config.xml"/>
>>> 
>>> You might want to look at a tutorial I wrote on how to create a simple PGE [1]
located within JIRA issue [2]. This tutorial includes a full sample PGEConfig.xml file with
the example above in context. I'm in the process of converting this to xdoc for the OODT site,
but feel free to try it out!
>>> 
>>> [1] https://issues.apache.org/jira/secure/attachment/12489556/CAS-PGE_learn_by_example.docx
>>> [2] https://issues.apache.org/jira/browse/OODT-217
>>> 
>>> Thanks,
>>> Rishi
>>> 
>>> On Sep 22, 2011, at 4:45 PM, Cayanan, Michael D (388J) wrote:
>>> 
>>>> Is there a mechanism in CAS PGE to tell the file manager to only ingest
>>>> certain files? If so, how is this done? Is it through a "metout" file of
>>>> some sort?
>>>> 
>>>> We'd like to use this feature (if it exists) in SMAP.
>>>> 
>>>> Thanks,
>>>> Mike
>>> 
>>> 
>>> 
>>> 
>>> --
>>> -Sheryl
>> 
>> 
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> 
>> 
>> 
>> 
>> -- 
>> -Sheryl
> 
> 
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> 


Mime
View raw message