oodt-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stough, Timothy M (388F)" <timothy.m.sto...@jpl.nasa.gov>
Subject Re: Two File Manager Questions
Date Wed, 09 Nov 2011 18:40:07 GMT
Cecilia,

Thanks for the reply.  I tried your suggested query and got similar results as before.  Here's
what I tried...

In preparation, I ingested a blank text file with the same product name as in your example:

[stough@aria1 bin]$ ./filemgr-client --url http://localhost:9000 --operation --ingestProduct
--productName acos_qSnd_090627_04_Production_v050050_Sel2900_r05_111109172137i.txt --productStructure
Flat --productTypeName GenericFile --metadataFile file:///proj/aria/cas/data-system/bin/blah.txt.met
--refs file:///proj/aria/cas/data-system/bin/blah.txt
Nov 9, 2011 10:32:35 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
INFO: Loading File Manager Configuration Properties from: [../etc/filemgr.properties]
ingestProduct: Result: 31f26edf-0b01-11e1-b910-4da260ad04a8

It was properly ingested as indicated in the logs:

Nov 9, 2011 10:32:35 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor: [org.apache.oodt.cas.filemgr.metadata.extractors.CoreMetExtractor]
for product type: [GenericFile]
Nov 9, 2011 10:32:35 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor: [org.apache.oodt.cas.filemgr.metadata.extractors.examples.MimeTypeExtractor]
for product type: [GenericFile]
Nov 9, 2011 10:32:35 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor: [org.apache.oodt.cas.filemgr.metadata.extractors.examples.FinalFileLocationExtractor]
for product type: [GenericFile]
Nov 9, 2011 10:32:35 AM org.apache.oodt.cas.filemgr.catalog.LuceneCatalog toDoc
WARNING: No Metadata specified for product [acos_qSnd_090627_04_Production_v050050_Sel2900_r05_111109172137i.txt]
for required field [DataVersion]: Attempting to continue processing metadata
Nov 9, 2011 10:32:35 AM org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferer moveFile
INFO: LocalDataTransfer: Moving File: file:///proj/aria/cas/data-system/bin/blah.txt to file:/proj/aria/repository/files/acos_qSnd_090627_04_Production_v050050_Sel2900_r05_111109172137i.txt/blah.txt
Nov 9, 2011 10:32:35 AM org.apache.oodt.cas.filemgr.catalog.LuceneCatalog toDoc
WARNING: No Metadata specified for product [acos_qSnd_090627_04_Production_v050050_Sel2900_r05_111109172137i.txt]
for required field [DataVersion]: Attempting to continue processing metadata

I tried the query that you suggested with a few minor mods for my install:

./query_tool --url http://localhost:9000 --lucene -query CAS.ProductName:acos_qSnd_090627_04_Production_v050050_Sel2900_r05_111109172137i.txt

and got the following in my File Manager logs:

datacasting 3.1.0cWARNING: Query: [q=CAS.ProductName:acos AND CAS.ProductName:qSnd_090627_04
AND CAS.ProductName:Production_v050050_Sel2900_r05_111109172137i AND CAS.ProductName:txt]
for Product Type: [urn:oodt:GenericFile] returned no results

The addition of single, or double quotes had no effect.

Anymore thoughts?

Thanks,
Tim.

On Nov 9, 2011, at 9:52 AM, Cheng, Cecilia S (388K) wrote:
> Looks like emails to user@oodt.apache.org take longer to arrive, so I’m sending this
directly to you. Hope it helps.
> 
> -- cecilia
> 
> ------ Forwarded Message
> From: "Cheng, Cecilia S (388K)" <cecilia.s.cheng@jpl.nasa.gov>
> Date: Wed, 9 Nov 2011 09:30:37 -0800
> To: "user@oodt.apache.org" <user@oodt.apache.org>
> Subject: Re: Two File Manager Questions
> 
> Hi Tim,
> 
> > B) Disallowed characters in product names?
> > 
> >  My product names look like this:  "ALPSRP225250610-H1.0__A"  If I try to 
> > search for a product by name using a Lucene query through query_tool, the 
> > query breaks across the "_".  What I see in the log is:
> > 
> > WARNING: Query: [q=Filename:ALPSRP154650650-H1.0 AND Filename:A] for Product 
> > Type: [urn:oodt:GenericFile] returned no results
> > 
> > So it looks like the __ gets turned into an "AND".  What's the deal and how do 
> > I fix it?
> 
> The '_' in the product name works for us. See:
> 
>> $ ./query_tool --url $FILEMGR_URL --lucene -query FILENAME:acos_qSnd_090627_04_Production_v050050_Sel2900_r05_111109172137i.txt
>> 7151
> 
> Maybe you can try putting single quotes around the file name. See:
> 
>> $ ./query_tool --url $FILEMGR_URL --lucene -query FILENAME:'acos_qSnd_090627_04_Production_v050050_Sel2900_r05_111109172137i.txt'
>> 7151
> 
> -- cecilia
> 
> 
> ------ End of Forwarded Message

-----------------------------------------------------------------
Tim Stough
NASA/Caltech Jet Propulsion Lab
Senior System Architect
Data Understanding Group (Section 388)
818-393-5347 (office)
626-644-6574 (cell)
-----------------------------------------------------------------






Mime
View raw message