oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mattmann, Chris A (388J)" <chris.a.mattm...@jpl.nasa.gov>
Subject Re: Issue with query_tool when all product types are not populated
Date Thu, 23 Feb 2012 14:22:33 GMT
Thanks Sheryl, you rock!

Cheers,
Chris

On Feb 23, 2012, at 12:48 AM, Sheryl John wrote:

> I've added an issue for this :
> https://issues.apache.org/jira/browse/OODT-384
> 
> Thanks,
> 
> On Wed, Feb 22, 2012 at 9:38 PM, Mattmann, Chris A (388J) <
> chris.a.mattmann@jpl.nasa.gov> wrote:
> 
>> Thanks for the case Sheryl. Would you mind filing a JIRA issue for 0.5 to
>> investigate this?
>> 
>> Cheers,
>> Chris
>> 
>> On Feb 22, 2012, at 3:49 PM, Sheryl John wrote:
>> 
>>> Hi,
>>> 
>>> I've experienced the same today while working with 0.4-snapshot (not
>> latest
>>> build ) and also the query does not seem to accept '*' for the elements.
>>> For the following use case:
>>> 
>>> ./filemgr-client --url http://localhost:9000 -op -sql -query "SELECT *
>> FROM
>>> CernerLocations"
>>> 
>>> The stack trace:
>>> 
>>> Feb 22, 2012 2:36:52 PM
>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager complexQuery
>>> INFO: Query returned 2 results
>>> org.apache.xmlrpc.XmlRpcException: org.apache.xmlrpc.XmlRpcException:
>> null
>>> values not supported by XML-RPC
>>> at
>>> 
>> org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcClientResponseProcessor.java:104)
>>> at
>>> 
>> org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClientResponseProcessor.java:71)
>>> at
>> org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73)
>>> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194)
>>> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185)
>>> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178)
>>> at
>>> 
>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.complexQuery(XmlRpcFileManagerClient.java:974)
>>> at
>>> 
>> org.apache.oodt.cas.filemgr.cli.action.AbstractQueryCliAction.execute(AbstractQueryCliAction.java:75)
>>> at
>> org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:296)
>>> at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:179)
>>> at
>>> 
>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFileManagerClient.java:1307)
>>> ERROR: Failed to perform sql query : sortBy 'null', outputFormat 'null',
>>> and delimiter '
>>> ', filterAlgor 'null', startDateTimeMetKey 'null', endDateTimeMetKey
>>> 'null', priorityMetKey 'null', null' : org.apache.xmlrpc.XmlRpcException:
>>> null values not supported by XML-RPC
>>> 
>>> 
>>> But if add the elements' names in the query I get the desired query
>> results.
>>> 
>>> ./filemgr-client --url http://palmer:9000 -op -sql -query "SELECT
>>> CAS.ProductName,PID FROM CernerLocations"
>>> 
>>> Feb 22, 2012 2:45:22 PM
>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager complexQuery
>>> INFO: Query returned 2 results
>>> blah_xx.csv,xxxx
>>> blah_yy.csv,yyyy
>>> 
>>> 
>>> 
>>> 
>>> On Tue, Feb 21, 2012 at 1:38 PM, Mattmann, Chris A (388J) <
>>> chris.a.mattmann@jpl.nasa.gov> wrote:
>>> 
>>>> Hey Sean,
>>>> 
>>>> Thanks for the FYI. OK, so it's not a regression, but it sounds worthy
>> of
>>>> a JIRA
>>>> issue. I'd say go for it and let's investigate the fix, even if it means
>>>> porting it
>>>> out of wengine.
>>>> 
>>>> Cheers,
>>>> Chris
>>>> 
>>>> On Feb 21, 2012, at 10:23 AM, Hardman, Sean H (388J) wrote:
>>>> 
>>>>> Hey Chris,
>>>>> 
>>>>> Yes, the identical behavior can be seen 0.3, I am just slow to complain
>>>>> about it. I haven't tried 0.2, but this query does work successfully
in
>>>>> the wengine-branch version of the FM. For clarification, the --lucene
>>>>> query option [1] and --sql query option [2] where I limit the query to
>>>> the
>>>>> product type that I ingested with, work fine.
>>>>> 
>>>>> Thanks,
>>>>> Sean
>>>>> 
>>>>> [1] query_tool --url ${FILEMGR_URL} --lucene -query "ProductType:
>>>>> CatalogFile"
>>>>> [2] query tool --url ${FILEMGR_URL} --sql -query "SELECT * FROM
>>>>> CatalogFile"
>>>>> 
>>>>> On 2/20/12 11:28 PM, "Mattmann, Chris A (388J)"
>>>>> <chris.a.mattmann@jpl.nasa.gov> wrote:
>>>>> 
>>>>>> Hey Sean,
>>>>>> 
>>>>>> Interesting. Can you try with 0.3 and see if it gives you a different
>>>>>> behavior? If it's a regression I'm happy to file an issue
>>>>>> and/or create a unit test for it.
>>>>>> 
>>>>>> Cheers,
>>>>>> Chris
>>>>>> 
>>>>>> On Feb 20, 2012, at 6:30 PM, Hardman, Sean H (388J) wrote:
>>>>>> 
>>>>>>> I first noticed this behavior in release 0.3 and just reaffirmed
it
>> in
>>>>>>> a latest and greatest build of 0.4-SNAPSHOT. To the best of my
>>>>>>> knowledge, this was not the case in previous versions. When querying
>> a
>>>>>>> File Manager instance with a Lucene Catalog on the back end,
the
>>>>>>> query_tool will throw an exception unless there is a product
ingested
>>>>>>> for each product type listed in the policy (see the stack trace
>> below).
>>>>>>> 
>>>>>>> I assume I am not the first person to notice this behavior. Is
this
>>>>>>> worthy of a JIRA issue?
>>>>>>> 
>>>>>>> Thanks,
>>>>>>> Sean
>>>>>>> 
>>>>>>> 
>>>>>>> bash-3.2$ ./query_tool --url ${FILEMGR_URL} --sql -query "SELECT
*
>> FROM
>>>>>>> *"
>>>>>>> Feb 20, 2012 5:52:26 PM
>>>>>>> org.apache.oodt.cas.filemgr.catalog.LuceneCatalog paginateQuery
>>>>>>> WARNING: Query: [q=] for Product Type: [urn:pds:CatalogObject]
>> returned
>>>>>>> no results
>>>>>>> java.lang.NullPointerException
>>>>>>> at
>>>>>>> 
>>>> 
>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.complexQuery(XmlRpcF
>>>>>>> ileManager.java:602)
>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>> at
>>>>>>> 
>>>> 
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java
>>>>>>> :39)
>>>>>>> at
>>>>>>> 
>>>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI
>>>>>>> mpl.java:25)
>>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>> at org.apache.xmlrpc.Invoker.execute(Invoker.java:130)
>>>>>>> at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(XmlRpcWorker.java:84)
>>>>>>> at org.apache.xmlrpc.XmlRpcWorker.execute(XmlRpcWorker.java:146)
>>>>>>> at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:139)
>>>>>>> at org.apache.xmlrpc.XmlRpcServer.execute(XmlRpcServer.java:125)
>>>>>>> at org.apache.xmlrpc.WebServer$Connection.run(WebServer.java:761)
>>>>>>> at org.apache.xmlrpc.WebServer$Runner.run(WebServer.java:642)
>>>>>>> at java.lang.Thread.run(Thread.java:680)
>>>>>>> org.apache.xmlrpc.XmlRpcException: java.lang.Exception:
>>>>>>> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException:
>> Failed
>>>>>>> to perform complex query : null
>>>>>>> at
>>>>>>> 
>>>> 
>> org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcCli
>>>>>>> entResponseProcessor.java:104)
>>>>>>> at
>>>>>>> 
>>>> 
>> org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClie
>>>>>>> ntResponseProcessor.java:71)
>>>>>>> at
>>>>>>> 
>>>> org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73)
>>>>>>> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194)
>>>>>>> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185)
>>>>>>> at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178)
>>>>>>> at
>>>>>>> 
>>>> 
>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.complexQuery(X
>>>>>>> mlRpcFileManagerClient.java:974)
>>>>>>> at
>>>>>>> 
>>>> 
>> org.apache.oodt.cas.filemgr.tools.QueryTool.performSqlQuery(QueryTool.jav
>>>>>>> a:252)
>>>>>>> at
>> org.apache.oodt.cas.filemgr.tools.QueryTool.main(QueryTool.java:242)
>>>>>>> Exception in thread "main"
>>>>>>> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException:
>>>>>>> java.lang.Exception:
>>>>>>> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException:
>> Failed
>>>>>>> to perform complex query : null
>>>>>>> at
>>>>>>> 
>>>> 
>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.complexQuery(X
>>>>>>> mlRpcFileManagerClient.java:980)
>>>>>>> at
>>>>>>> 
>>>> 
>> org.apache.oodt.cas.filemgr.tools.QueryTool.performSqlQuery(QueryTool.jav
>>>>>>> a:252)
>>>>>>> at
>> org.apache.oodt.cas.filemgr.tools.QueryTool.main(QueryTool.java:242)
>>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>> Chris Mattmann, Ph.D.
>>>>>> Senior Computer Scientist
>>>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>>>> Office: 171-266B, Mailstop: 171-246
>>>>>> Email: chris.a.mattmann@nasa.gov
>>>>>> WWW:   http://sunset.usc.edu/~mattmann/
>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>> Adjunct Assistant Professor, Computer Science Department
>>>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Chris Mattmann, Ph.D.
>>>> Senior Computer Scientist
>>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>>> Office: 171-266B, Mailstop: 171-246
>>>> Email: chris.a.mattmann@nasa.gov
>>>> WWW:   http://sunset.usc.edu/~mattmann/
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> Adjunct Assistant Professor, Computer Science Department
>>>> University of Southern California, Los Angeles, CA 90089 USA
>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>> 
>>>> 
>>> 
>>> 
>>> --
>>> -Sheryl
>> 
>> 
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattmann@nasa.gov
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> 
>> 
> 
> 
> --
> -Sheryl


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Mime
View raw message