oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hardman, Sean H (388J)" <sean.h.hard...@jpl.nasa.gov>
Subject Issue with File Manager initiating a Lucene Catalog
Date Tue, 21 Feb 2012 02:57:56 GMT
Sorry for spamming the list today but I have been doing some comparative tests today with the
File Manager. When populating a newly installed version (0.4-SNAPSHOT) of the File Manager,
I was unable to ingest a product until I supplied an existing (yet empty of products) Lucene
Catalog for the File Manager to populate. I have included the stack trace from both the client
and the server below. This isn't the behavior seen in the 0.3 release. If the Lucene Catalog
does not exist in 0.3, it is created upon the first file ingestion.

Once again, I am not sure whether this is worthy of a JIRA issue. I am just pointing out differing
behavior.

Thanks,
Sean


Stack trace from filemgr-client:

bash-3.2$ ./filemgr-client --url http://localhost:9000 --operation --ingestProduct --productName
Test --productStructure Flat --productTypeName CatalogFile --metadataFile "file:///Users/shardman/deploy/pds-build2b/storage-0.2.0/test/test.txt.met"
--refs "file:///Users/shardman/deploy/pds-build2b/storage-0.2.0/test/test.txt"
Feb 20, 2012 6:49:30 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
INFO: Loading File Manager Configuration Properties from: [../etc/filemgr.properties]
org.apache.xmlrpc.XmlRpcException: java.lang.Exception: org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException:
Error ingesting product [org.apache.oodt.cas.filemgr.structs.Product@3e4a9a7d] : Unable to
index product: [Test]: Message: /Users/shardman/deploy/oodt/catalog/segments (No such file
or directory)
at org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcClientResponseProcessor.java:104)
at org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClientResponseProcessor.java:71)
at org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.ingestProduct(XmlRpcFileManagerClient.java:1162)
at org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction.execute(IngestProductCliAction.java:102)
at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:296)
at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:179)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFileManagerClient.java:1307)
Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient ingestProduct
SEVERE: Failed to ingest product [org.apache.oodt.cas.filemgr.structs.Product@535c97e4] :
java.lang.Exception: org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@3e4a9a7d] : Unable to index
product: [Test]: Message: /Users/shardman/deploy/oodt/catalog/segments (No such file or directory)
-- rolling back ingest
Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient ingestProduct
SEVERE: Failed to rollback ingest of product [org.apache.oodt.cas.filemgr.structs.Product@535c97e4]
: java.lang.Exception: org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@3e4a9a7d] : Unable to index
product: [Test]: Message: /Users/shardman/deploy/oodt/catalog/segments (No such file or directory)
ERROR: Failed to ingest product 'Test' : Failed to ingest product [org.apache.oodt.cas.filemgr.structs.Product@535c97e4]
: java.lang.Exception: org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@3e4a9a7d] : Unable to index
product: [Test]: Message: /Users/shardman/deploy/oodt/catalog/segments (No such file or directory)

Stack trace from filemgr:

Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor: [org.apache.oodt.cas.filemgr.metadata.extractors.CoreMetExtractor]
for product type: [CatalogFile]
Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor: [org.apache.oodt.cas.filemgr.metadata.extractors.examples.MimeTypeExtractor]
for product type: [CatalogFile]
Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager runExtractors
INFO: Running Met Extractor: [org.apache.oodt.cas.filemgr.metadata.extractors.examples.FinalFileLocationExtractor]
for product type: [CatalogFile]
Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.catalog.LuceneCatalog addCompleteProductToIndex
WARNING: Unable to index product: [Test]: Message: /Users/shardman/deploy/oodt/catalog/segments
(No such file or directory)
java.io.FileNotFoundException: /Users/shardman/deploy/oodt/catalog/segments (No such file
or directory)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:216)
at org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:430)
at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:439)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:329)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:45)
at org.apache.lucene.index.IndexWriter$1.doBody(IndexWriter.java:264)
at org.apache.lucene.store.Lock$With.run(Lock.java:99)
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:259)
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:204)
at org.apache.oodt.cas.filemgr.catalog.LuceneCatalog.addCompleteProductToIndex(LuceneCatalog.java:990)
at org.apache.oodt.cas.filemgr.catalog.LuceneCatalog.addProductReferences(LuceneCatalog.java:336)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.addProductReferences(XmlRpcFileManager.java:1097)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.ingestProduct(XmlRpcFileManager.java:740)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.xmlrpc.Invoker.execute(Invoker.java:130)
at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84)
at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125)
at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761)
at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642)
at java.lang.Thread.run(Thread.java:680)
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Unable to index product:
[Test]: Message: /Users/shardman/deploy/oodt/catalog/segments (No such file or directory)
at org.apache.oodt.cas.filemgr.catalog.LuceneCatalog.addCompleteProductToIndex(LuceneCatalog.java:1005)
at org.apache.oodt.cas.filemgr.catalog.LuceneCatalog.addProductReferences(LuceneCatalog.java:336)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.addProductReferences(XmlRpcFileManager.java:1097)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.ingestProduct(XmlRpcFileManager.java:740)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.xmlrpc.Invoker.execute(Invoker.java:130)
at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84)
at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125)
at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761)
at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642)
at java.lang.Thread.run(Thread.java:680)
Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.catalog.LuceneCatalog removeProductDocument
WARNING: Exception removing product: [Test] from index: Message: /Users/shardman/deploy/oodt/catalog/segments
(No such file or directory)
Feb 20, 2012 6:49:31 PM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager removeProduct
WARNING: Exception modifying product: [null]: Message: /Users/shardman/deploy/oodt/catalog/segments
(No such file or directory)
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: /Users/shardman/deploy/oodt/catalog/segments
(No such file or directory)
at org.apache.oodt.cas.filemgr.catalog.LuceneCatalog.removeProductDocument(LuceneCatalog.java:962)
at org.apache.oodt.cas.filemgr.catalog.LuceneCatalog.removeProduct(LuceneCatalog.java:298)
at org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct(XmlRpcFileManager.java:926)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.xmlrpc.Invoker.execute(Invoker.java:130)
at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84)
at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139)
at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125)
at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761)
at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642)
at java.lang.Thread.run(Thread.java:680)


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message