oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wong, Cynthia L (398G)" <cynthia.l.w...@jpl.nasa.gov>
Subject Re: OODT 0.10 FileMgr Errors
Date Mon, 26 Oct 2015 18:06:43 GMT
Chris,

Here is the filemgr.properties deployed by RADIX. I modified slightly for
my project. I also verified that FILEMGR_HOME contains valid path. The odd
is that I can ingest but I can’t delete. If there is problem with
FILEMGR_HOME, then ingest should break too.

I originally could not check for the ingested product (-product -pn)
either due to multiple records in the catalog for the same product. I
cleaned up the catalog and ingested only one record but I still can’t
delete the product.

Here is the segment of filemgr.properties. I noticed that lines contain
“file:[FILEMGR_HOME]” rather than “file://[FILEMGR_HOME]".

# lucene catalog configuration
org.apache.oodt.cas.filemgr.catalog.lucene.idxPath=[OODT_HOME]/data/catalog
org.apache.oodt.cas.filemgr.catalog.lucene.pageSize=20
org.apache.oodt.cas.filemgr.catalog.lucene.commitLockTimeout.seconds=60
org.apache.oodt.cas.filemgr.catalog.lucene.writeLockTimeout.seconds=60
org.apache.oodt.cas.filemgr.catalog.lucene.mergeFactor=20

# XML repository manager configuration
org.apache.oodt.cas.filemgr.repositorymgr.dirs=file:[FILEMGR_HOME]/policy/o
odt,file:[FILEMGR_HOME]/policy/gnss-h2o

# XML validation layer configuration
org.apache.oodt.cas.filemgr.validation.dirs=file:[FILEMGR_HOME]/policy/oodt
,file:[FILEMGR_HOME]/policy/gnss-h2o

# remote data transfer configuration
org.apache.oodt.cas.filemgr.datatransfer.remote.chunkSize=1024

# location of Mime-Type repository
org.apache.oodt.cas.filemgr.mime.type.repository=[FILEMGR_HOME]/etc/mime-ty
pes.xml



I changed those lines to have “file://[FILEMGR_HOME]"


# XML repository manager configuration
org.apache.oodt.cas.filemgr.repositorymgr.dirs=file://[FILEMGR_HOME]/policy
/oodt,file://[FILEMGR_HOME]/policy/gnss-h2o

# XML validation layer configuration
org.apache.oodt.cas.filemgr.validation.dirs=file://[FILEMGR_HOME]/policy/oo
dt,file://[FILEMGR_HOME]/policy/gnss-h2o


% fm -dbyid -pid ca00685a-79d4-11e5-9cae-33480ce63ace
ERROR: Failed to delete product
'org.apache.oodt.cas.filemgr.structs.Product@3d52315f' :
java.lang.Exception: java.lang.IllegalArgumentException: URI is not
absolute



But, the result is same. Then, I replaced all FILEMGR_HOME in
filemgr.properties with valid paths. Same result…

FYI. My ingest command is as below:

% ./filemgr-client -url http://localhost:9000 -op -ingest -ptn rinex -ps
Flat -mf 
"file:///project/amigho/deploy/gnss-h2o/pcs/data/staging/p1012850.15S.met"
-rs "file:///project/amigho/deploy/gnss-h2o/pcs/data/staging/p1012850.15S"
-pn p1012850.15S

However, I found in lucene the <reference_data_store> contains an illegal
path. I’m not sure if that causes the problem for deletion. But, I see
this in other catalog (i.e. SMAP) too but it can be deleted. I’m sort of
stuck. ;) No big deal. I just can’t test and will have to remove the
entire catalog every time.

 



BTW, RADIX does not deploy filemgr/etc/logging.properties.

Thanks for your & Lewis’ pointer. I will continue to troubleshoot.
Cynthia




On 10/25/15, 10:33 AM, "Mattmann, Chris A (3980)"
<chris.a.mattmann@jpl.nasa.gov> wrote:

>Cynthia,
>
>The:
>
>"URI is not absolute”
>
>error is a long standing configuration issue wherein which
>an environment variable referenced in a config (likely
>etc/filemgr.properties)
>is not defined, and there is a file://[SOME_VAR] use of it, that is a
>URI. In this case you get a non absolute URI an hence the error.
>
>Please check your filemgr.properties and other configs as that is
>the most likely cause of your problem.
>
>Cheers,
>Chris
>
>
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Chris Mattmann, Ph.D.
>Chief Architect
>Instrument Software and Science Data Systems Section (398)
>NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>Office: 168-519, Mailstop: 168-527
>Email: chris.a.mattmann@nasa.gov
>WWW:  http://sunset.usc.edu/~mattmann/
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Adjunct Associate Professor, Computer Science Department
>University of Southern California, Los Angeles, CA 90089 USA
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>
>-----Original Message-----
>From: "Wong, Cynthia L (398G)" <cynthia.l.wong@jpl.nasa.gov>
>Reply-To: "dev@oodt.apache.org" <dev@oodt.apache.org>
>Date: Thursday, October 22, 2015 at 4:15 PM
>To: "dev@oodt.apache.org" <dev@oodt.apache.org>
>Subject: OODT 0.10 FileMgr Errors
>
>>All,
>>
>>I¹m checking out OODT 0.10. Do you know if it works with JDK 1.7?
>>
>>I am able to ingest files but I can not perform the following commands to
>>get info or delete them.
>>
>>% ./filemgr-client -url http://localhost:9000 -op -product -pn
>>p1012850.15S
>>% ./filemgr-client -url http://localhost:9000 -op -pbyn -pn p1012850.15S
>>% ./filemgr-client -url http://localhost:9000 -op --deleteProductByName
>>-pn p1012850.15S
>>% ./filemgr-client -url http://localhost:9000 -op -dbyn -pn p1012850.15S
>>% ./filemgr-client -url http://localhost:9000 -op -dbyid -pid
>>68c41375-782d-11e5-808e-dd817024279f
>>
>>The error message onto console:
>>
>>ERROR: Failed to delete product
>>'org.apache.oodt.cas.filemgr.structs.Product@27a8eaf7' :
>>java.lang.Exception: java.lang.IllegalArgumentException: URI is not
>>absolute
>>
>>
>>And a list of files were ingested (in lucene):
>>
>>% ./filemgr-client -url http://localhost:9000 -op -page1 -ptn rinex
>>Page: [num=1, totalPages=1, pageSize=20]
>>Products:
>>Product: 
>>[id=68c41375-782d-11e5-808e-dd817024279f,name=p1012850.15S,type=rinex,str
>>u
>>c
>>ture=Flat, transferStatus=TRANSFERING]
>>Product: 
>>[id=ba7a0b76-782d-11e5-808e-dd817024279f,name=p1012850.15S,type=rinex,str
>>u
>>c
>>ture=Flat, transferStatus=TRANSFERING]
>>Product: 
>>[id=dadee437-782d-11e5-808e-dd817024279f,name=p1012850.15S,type=rinex,str
>>u
>>c
>>ture=Flat, transferStatus=RECEIVED]
>>Product: 
>>[id=ce936405-782f-11e5-adf7-2f670ce93a4d,name=p1012850.15S,type=rinex,str
>>u
>>c
>>ture=Flat, transferStatus=RECEIVED]
>>Product: 
>>[id=e01b7556-782f-11e5-adf7-2f670ce93a4d,name=p1012850.15S,type=rinex,str
>>u
>>c
>>ture=Flat, transferStatus=RECEIVED]
>>Product: 
>>[id=2d6c0385-78e7-11e5-be8b-2f30a366015e,name=p1012850.15S,type=rinex,str
>>u
>>c
>>ture=Flat, transferStatus=RECEIVED]
>>
>>
>>
>>
>>
>>
>>
>>
>>FileMgr log contains the following errors that lead me think of
>>compatibility issue.
>>
>>
>>Oct 22, 2015 3:52:05 PM
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver
>>initHandlerMappings
>>FINE: Ignoring namespace handler
>>[org.springframework.scripting.config.LangNamespaceHandler]: handler
>>class
>>not found
>>java.lang.ClassNotFoundException:
>>org.springframework.scripting.config.LangNamespaceHandler
>>	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>	at java.security.AccessController.doPrivileged(Native Method)
>>	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>>	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>>	at org.springframework.util.ClassUtils.forName(ClassUtils.java:249)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.ini
>>t
>>H
>>andlerMappings(DefaultNamespaceHandlerResolver.java:117)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in
>>i
>>t
>>>(DefaultNamespaceHandlerResolver.java:96)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in
>>i
>>t
>>>(DefaultNamespaceHandlerResolver.java:83)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createDefau
>>l
>>t
>>NamespaceHandlerResolver(XmlBeanDefinitionReader.java:498)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createReade
>>r
>>C
>>ontext(XmlBeanDefinitionReader.java:487)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBea
>>n
>>D
>>efinitions(XmlBeanDefinitionReader.java:468)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanD
>>e
>>f
>>initions(XmlBeanDefinitionReader.java:363)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef
>>i
>>n
>>itions(XmlBeanDefinitionReader.java:313)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef
>>i
>>n
>>itions(XmlBeanDefinitionReader.java:290)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:131)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:147)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:173)
>>	at 
>>org.springframework.context.support.AbstractXmlApplicationContext.loadBea
>>n
>>D
>>efinitions(AbstractXmlApplicationContext.java:112)
>>	at 
>>org.springframework.context.support.AbstractXmlApplicationContext.loadBea
>>n
>>D
>>efinitions(AbstractXmlApplicationContext.java:79)
>>	at 
>>org.springframework.context.support.AbstractRefreshableApplicationContext
>>.
>>r
>>efreshBeanFactory(AbstractRefreshableApplicationContext.java:101)
>>	at 
>>org.springframework.context.support.AbstractApplicationContext.obtainFres
>>h
>>B
>>eanFactory(AbstractApplicationContext.java:394)
>>	at 
>>org.springframework.context.support.AbstractApplicationContext.refresh(Ab
>>s
>>t
>>ractApplicationContext.java:324)
>>	at 
>>org.springframework.context.support.FileSystemXmlApplicationContext.<init
>>>
>>(
>>FileSystemXmlApplicationContext.java:124)
>>	at 
>>org.springframework.context.support.FileSystemXmlApplicationContext.<init
>>>
>>(
>>FileSystemXmlApplicationContext.java:68)
>>	at 
>>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStore.<ini
>>t
>>>
>>(SpringCmdLineOptionStore.java:45)
>>	at 
>>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStoreFacto
>>r
>>y
>>.createStore(SpringCmdLineOptionStoreFactory.java:42)
>>	at org.apache.oodt.cas.cli.CmdLineUtility.<init>(CmdLineUtility.java:94)
>>	at 
>>org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFil
>>e
>>M
>>anagerClient.java:1349)
>>
>>
>>Oct 22, 2015 3:52:05 PM
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver
>>initHandlerMappings
>>FINE: Ignoring namespace handler
>>[org.springframework.ejb.config.JeeNamespaceHandler]: handler class not
>>found
>>java.lang.ClassNotFoundException:
>>org.springframework.ejb.config.JeeNamespaceHandler
>>	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>	at java.security.AccessController.doPrivileged(Native Method)
>>	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>>	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>>	at org.springframework.util.ClassUtils.forName(ClassUtils.java:249)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.ini
>>t
>>H
>>andlerMappings(DefaultNamespaceHandlerResolver.java:117)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in
>>i
>>t
>>>(DefaultNamespaceHandlerResolver.java:96)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in
>>i
>>t
>>>(DefaultNamespaceHandlerResolver.java:83)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createDefau
>>l
>>t
>>NamespaceHandlerResolver(XmlBeanDefinitionReader.java:498)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createReade
>>r
>>C
>>ontext(XmlBeanDefinitionReader.java:487)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBea
>>n
>>D
>>efinitions(XmlBeanDefinitionReader.java:468)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanD
>>e
>>f
>>initions(XmlBeanDefinitionReader.java:363)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef
>>i
>>n
>>itions(XmlBeanDefinitionReader.java:313)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef
>>i
>>n
>>itions(XmlBeanDefinitionReader.java:290)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:131)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:147)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:173)
>>	at 
>>org.springframework.context.support.AbstractXmlApplicationContext.loadBea
>>n
>>D
>>efinitions(AbstractXmlApplicationContext.java:112)
>>	at 
>>org.springframework.context.support.AbstractXmlApplicationContext.loadBea
>>n
>>D
>>efinitions(AbstractXmlApplicationContext.java:79)
>>	at 
>>org.springframework.context.support.AbstractRefreshableApplicationContext
>>.
>>r
>>efreshBeanFactory(AbstractRefreshableApplicationContext.java:101)
>>	at 
>>org.springframework.context.support.AbstractApplicationContext.obtainFres
>>h
>>B
>>eanFactory(AbstractApplicationContext.java:394)
>>	at 
>>org.springframework.context.support.AbstractApplicationContext.refresh(Ab
>>s
>>t
>>ractApplicationContext.java:324)
>>	at 
>>org.springframework.context.support.FileSystemXmlApplicationContext.<init
>>>
>>(
>>FileSystemXmlApplicationContext.java:124)
>>	at 
>>org.springframework.context.support.FileSystemXmlApplicationContext.<init
>>>
>>(
>>FileSystemXmlApplicationContext.java:68)
>>	at 
>>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStore.<ini
>>t
>>>
>>(SpringCmdLineOptionStore.java:45)
>>	at 
>>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStoreFacto
>>r
>>y
>>.createStore(SpringCmdLineOptionStoreFactory.java:42)
>>	at org.apache.oodt.cas.cli.CmdLineUtility.<init>(CmdLineUtility.java:94)
>>	at 
>>org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFil
>>e
>>M
>>anagerClient.java:1349)
>>
>>
>>Oct 22, 2015 3:52:05 PM
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver
>>initHandlerMappings
>>FINE: Ignoring namespace handler
>>[org.springframework.aop.config.AopNamespaceHandler]: handler class not
>>found
>>java.lang.ClassNotFoundException:
>>org.springframework.aop.config.AopNamespaceHandler
>>	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>	at java.security.AccessController.doPrivileged(Native Method)
>>	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>>	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>>	at org.springframework.util.ClassUtils.forName(ClassUtils.java:249)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.ini
>>t
>>H
>>andlerMappings(DefaultNamespaceHandlerResolver.java:117)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in
>>i
>>t
>>>(DefaultNamespaceHandlerResolver.java:96)
>>	at 
>>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in
>>i
>>t
>>>(DefaultNamespaceHandlerResolver.java:83)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createDefau
>>l
>>t
>>NamespaceHandlerResolver(XmlBeanDefinitionReader.java:498)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createReade
>>r
>>C
>>ontext(XmlBeanDefinitionReader.java:487)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBea
>>n
>>D
>>efinitions(XmlBeanDefinitionReader.java:468)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanD
>>e
>>f
>>initions(XmlBeanDefinitionReader.java:363)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef
>>i
>>n
>>itions(XmlBeanDefinitionReader.java:313)
>>	at 
>>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef
>>i
>>n
>>itions(XmlBeanDefinitionReader.java:290)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:131)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:147)
>>	at 
>>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo
>>a
>>d
>>BeanDefinitions(AbstractBeanDefinitionReader.java:173)
>>	at 
>>org.springframework.context.support.AbstractXmlApplicationContext.loadBea
>>n
>>D
>>efinitions(AbstractXmlApplicationContext.java:112)
>>	at 
>>org.springframework.context.support.AbstractXmlApplicationContext.loadBea
>>n
>>D
>>efinitions(AbstractXmlApplicationContext.java:79)
>>	at 
>>org.springframework.context.support.AbstractRefreshableApplicationContext
>>.
>>r
>>efreshBeanFactory(AbstractRefreshableApplicationContext.java:101)
>>	at 
>>org.springframework.context.support.AbstractApplicationContext.obtainFres
>>h
>>B
>>eanFactory(AbstractApplicationContext.java:394)
>>	at 
>>org.springframework.context.support.AbstractApplicationContext.refresh(Ab
>>s
>>t
>>ractApplicationContext.java:324)
>>	at 
>>org.springframework.context.support.FileSystemXmlApplicationContext.<init
>>>
>>(
>>FileSystemXmlApplicationContext.java:124)
>>	at 
>>org.springframework.context.support.FileSystemXmlApplicationContext.<init
>>>
>>(
>>FileSystemXmlApplicationContext.java:68)
>>	at 
>>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStore.<ini
>>t
>>>
>>(SpringCmdLineOptionStore.java:45)
>>	at 
>>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStoreFacto
>>r
>>y
>>.createStore(SpringCmdLineOptionStoreFactory.java:42)
>>	at org.apache.oodt.cas.cli.CmdLineUtility.<init>(CmdLineUtility.java:94)
>>	at 
>>org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFil
>>e
>>M
>>anagerClient.java:1349)
>>
>>
>>Oct 22, 2015 3:52:05 PM
>>org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader
>>registerBeanDefinitions
>>FINE: Loading bean definitions
>>Oct 22, 2015 3:52:05 PM
>>org.springframework.beans.factory.xml.BeanDefinitionParserDelegate
>>parseBeanDefinitionElement
>>FINE: Neither XML 'id' nor 'name' specified - using generated bean name
>>[org.apache.oodt.cas.cli.option.handler.SetJavaPropertiesHandler#605514f9
>>]
>>
>>Any help is appreciated.
>>
>>
>>Cynthia
>>
>

Mime
  • Unnamed multipart/mixed (inline, None, 0 bytes)
View raw message