oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Verma, Rishi (317I)" <Rishi.Ve...@jpl.nasa.gov>
Subject Re: Filemanager how to only metadata
Date Tue, 28 Dec 2010 23:43:44 GMT
Hi Chris,

The filemgr-client usage statement seems to indicate support only for (--clienTransfer or
--dataTransfer) options, not the "--transferFactory" as you suggested.

In any case though, I tried a couple parameter arguments with filemgr-client, but all yield
an error saying a product specified with --refs could not be located:

1) ./filemgr-client ... --transferFactory InPlaceDataTransferFactory --refs file:///doesnotexist

2) ./filemgr-client ... --dataTransfer InPlaceDataTransferFactory --refs file:///doesnotexist

3) ./filemgr-client ... --dataTransfer org.apache.oodt.cas.filemgr.datatransfer.InPlaceDataTransfererFactory
--refs file:///doesnotexist

4) ./filemgr-client ... --transferFactory InPlaceDataTransfer --refs file:///doesnotexist

For all the above attempts, I see in the filemgr log the following exception:
SEVERE: ingestProduct: DataTransferException when transfering Product: test.h5: Message: Source
'/doesnotexist' does not exist
org.apache.oodt.cas.filemgr.structs.exceptions.DataTransferException: java.io.FileNotFoundException:
Source '/doesnotexist' does not exist

Do you have any tips on the above usage or why its still looking for a real product file?

Thank you!

On Dec 28, 2010, at 2:12 PM, Chris A Mattmann wrote:

Hi Rishi,

Thanks. You just need to specify InPlaceDataTransfer as the --transferFactory parameter to
the fmClient or to the crawler (which also expects a transfer factory)...


On Dec 28, 2010, at 1:54 PM, Verma, Rishi (317I) wrote:

Hi -

Thanks for the helpful tips.

I was looking at InPlaceDataTransferer, and it does not seem to have a command line interface
(there's no main). Specifically, I looked at the class

Is there a command-line wrapper already built I can use?

Thanks again!

On Dec 23, 2010, at 3:44 PM, holenoter wrote:

sounds like a case for the profile/product server . . . but if you really want to use the
filemgr, you can just use the InPlaceDataTransferer . . . if you mean by "i don't have the
product on hand" meaning it is stored somewhere else, then just put that url where it is stored
as the --ref arg . . . otherwise, if the product isn't anywhere, just put a random url as
the arg to --ref (e.g. file:///some/file/i/dont/have) . . . it will at least let you get the
metadata in


On Dec 23, 2010, at 2:28 PM, Verma, Rishi (317I) wrote:

Hi everyone,

I'm experimenting with OODT filemanager, and wanted to ingest a product file's met into the
filemgr catalog.

I don't have the product file on hand, but I do have the metadata.

The filemgr user's guide (ie. http://oodt.apache.org/components/maven/filemgr/user/basic.html)
documents how to ingest a product file assuming you actually have the product on hand. However,
if I only want to ingest the metadata, how would I go about doing this?

The 'filemgr-client' script seems to not allow ignoring the product reference. In other words,
I cannot simply eliminate the "--refs" flag.

./filemgr-client --url http://localhost:9000 --operation \
--ingestProduct --productName blah.txt --productStructure Flat \
--productTypeName GenericFile \
--metadataFile file:///usr/local/cas-filemgr-v1.8.0/bin/blah.txt.met \
--refs file:///usr/local/cas-filemgr-v1.8.0/bin/blah.txt

Any tips on how to ingest metadata only?


Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov<mailto:chris.a.mattmann@nasa.gov>
WWW:   http://sunset.usc.edu/~mattmann/
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message