oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Barber <tom.bar...@meteorite.bi>
Subject Re: FileManager: Delete Product Bug?
Date Mon, 08 Feb 2016 21:13:23 GMT
Might take a while as the hotel wifi just crashed :)
On 8 Feb 2016 21:47, "Tom Barber" <tom.barber@meteorite.bi> wrote:

> Probably not, but it's been a while. I'll spin up radix and have a fiddle.
>
> Tom
>
> On Mon, Feb 8, 2016 at 8:42 PM, Jordan Padams <jordan.padams@gmail.com>
> wrote:
>
>> Blast! You're right! I wasn't paying attention. Just pulled from
>> https://svn.apache.org/repos/asf/oodt/trunk/ instead of Github.
>>
>> Product delete - Success.
>>
>>
>> The "SELECT * ..." SQL query is still not returning anything. Am I doing
>> that wrong?
>>
>>
>> Thanks,
>> Jordan
>>
>>
>> On Mon, Feb 8, 2016 at 12:16 PM, Jordan Padams <jordan.padams@gmail.com>
>> wrote:
>>
>> > I just pulled the latest 0.11-SNAPSHOT from the trunk and rebuilt the
>> File
>> > Manager, but I now get a different error when trying to delete the
>> product:
>> >
>> > $ ./filemgr-client -op --hasProduct --productName blah.txt --url
>> > http://localhost:9000
>> > Feb 08, 2016 12:05:59 PM
>> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
>> > INFO: Loading File Manager Configuration Properties from:
>> > [../etc/filemgr.properties]
>> > hasProduct: Result: true
>> >
>> > $ ./filemgr-client -op --deleteProductByName --productName blah.txt
>> --url
>> > http://localhost:9000
>> > Feb 08, 2016 12:07:26 PM
>> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
>> > INFO: Loading File Manager Configuration Properties from:
>> > [../etc/filemgr.properties]
>> > Feb 08, 2016 12:07:26 PM
>> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
>> > INFO: Loading File Manager Configuration Properties from:
>> > [../etc/filemgr.properties]
>> > ERROR: Failed to delete product
>> > 'org.apache.oodt.cas.filemgr.structs.Product@2759b14b' :
>> > java.lang.Exception: java.lang.IllegalArgumentException: URI is not
>> absolute
>> >
>> >
>> >
>> > I also noticed some odd results when trying to perform a SQL query:
>> >
>> > $ ./filemgr-client --url http://localhost:9000 -op -sql -q "SELECT *
>> FROM
>> > GenericFile"
>> > Feb 08, 2016 12:13:31 PM
>> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
>> > INFO: Loading File Manager Configuration Properties from:
>> > [../etc/filemgr.properties]
>> > Feb 08, 2016 12:13:32 PM
>> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManager complexQuery
>> > INFO: Query returned 1 results
>> >
>> >
>> >
>> > But then it didn't actually return anything. If I use the deprecated
>> > query_tool (as is noted in the wiki instructions) it returns all of the
>> > metadata, as expected.
>> >
>> > Thanks,
>> > Jordan
>> >
>> > On Mon, Feb 8, 2016 at 9:15 AM, Jordan Padams <jordan.padams@gmail.com>
>> > wrote:
>> >
>> >> Thanks all. I will use the latest from trunk. Couldn't track down that
>> >> issue but glad it was caught.
>> >>
>> >> On Sun, Feb 7, 2016 at 10:29 AM, Lewis John Mcgibbney <
>> >> lewis.mcgibbney@gmail.com> wrote:
>> >>
>> >>> ACk thanks Tom. Good man.
>> >>>
>> >>> On Sun, Feb 7, 2016 at 10:27 AM, Tom Barber <tom.barber@meteorite.bi>
>> >>> wrote:
>> >>>
>> >>> > Yeah I fixed one delete bug and created another,  PITA. I created
>> the
>> >>> bug
>> >>> > so I'll fix the bug and as you're all so nice I might even write
>> you a
>> >>> test
>> >>> > to validate it ! ;)
>> >>> > On 7 Feb 2016 17:10, "Lewis John Mcgibbney" <
>> lewis.mcgibbney@gmail.com
>> >>> >
>> >>> > wrote:
>> >>> >
>> >>> > > ACK
>> >>> > > This issue clearly justifies a bug fix.
>> >>> > > Nice one Tom thanks for patching.
>> >>> > >
>> >>> > > On Sun, Feb 7, 2016 at 6:54 AM, Tom Barber <
>> tom.barber@meteorite.bi>
>> >>> > > wrote:
>> >>> > >
>> >>> > > > Fair enough!
>> >>> > > > On 7 Feb 2016 2:35 pm, "Mattmann, Chris A (3980)" <
>> >>> > > > chris.a.mattmann@jpl.nasa.gov> wrote:
>> >>> > > >
>> >>> > > > > Hey Tom, easier to just call it 0.12 and +1 to doing
so..
>> >>> > > > >
>> >>> > > > >
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>> > > > > Chris Mattmann, Ph.D.
>> >>> > > > > Chief Architect
>> >>> > > > > Instrument Software and Science Data Systems Section
(398)
>> >>> > > > > NASA Jet Propulsion Laboratory Pasadena, CA 91109
USA
>> >>> > > > > Office: 168-519, Mailstop: 168-527
>> >>> > > > > Email: chris.a.mattmann@nasa.gov
>> >>> > > > > WWW:  http://sunset.usc.edu/~mattmann/
>> >>> > > > >
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>> > > > > Adjunct Associate Professor, Computer Science Department
>> >>> > > > > University of Southern California, Los Angeles,
CA 90089 USA
>> >>> > > > >
>> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> >>> > > > >
>> >>> > > > >
>> >>> > > > >
>> >>> > > > >
>> >>> > > > >
>> >>> > > > > -----Original Message-----
>> >>> > > > > From: Tom Barber <tom.barber@meteorite.bi>
>> >>> > > > > Reply-To: "dev@oodt.apache.org" <dev@oodt.apache.org>
>> >>> > > > > Date: Saturday, February 6, 2016 at 11:42 PM
>> >>> > > > > To: "dev@oodt.apache.org" <dev@oodt.apache.org>
>> >>> > > > > Subject: Re: FileManager: Delete Product Bug?
>> >>> > > > >
>> >>> > > > > >Hi Jordan
>> >>> > > > > >
>> >>> > > > > >That error got flagged last week and patched
in trunk. You
>> >>> should be
>> >>> > > > able
>> >>> > > > > >to get the latest snapshot build and just copy
the file
>> manager
>> >>> > > snapshot
>> >>> > > > > >into your deployment.
>> >>> > > > > >
>> >>> > > > > >I'll ship a 0.11.1 next week to fix the issue.
>> >>> > > > > >
>> >>> > > > > >Tom
>> >>> > > > > >On 7 Feb 2016 03:36, "Jordan Padams" <
>> jordan.padams@gmail.com>
>> >>> > wrote:
>> >>> > > > > >
>> >>> > > > > >> I am using FileManager from OODT 0.11 and
I am having an
>> issue
>> >>> > > trying
>> >>> > > > to
>> >>> > > > > >> delete a product from the filemgr-client
tool.
>> >>> > > > > >>
>> >>> > > > > >> I followed the steps from the User Guide
[1] to test out
>> >>> > ingestion:
>> >>> > > > > >>
>> >>> > > > > >> $ ./filemgr-client --url http://localhost:9000
--operation
>> >>> > > > > >>--ingestProduct
>> >>> > > > > >> --productName blah.txt --productStructure
Flat
>> >>> --productTypeName
>> >>> > > > > >> GenericFile --metadataFile file:///tmp/blah.txt.met
--refs
>> >>> > > > > >> file:///tmp/blah.txt
>> >>> > > > > >> .
>> >>> > > > > >> .
>> >>> > > > > >> ingestProduct: Result: 573e5415-cd48-11e5-94c4-09fe75d3671d
>> >>> > > > > >>
>> >>> > > > > >> Then I the `deleteProductByName` operation
from the Solr
>> File
>> >>> > > Manager
>> >>> > > > > >>Wiki
>> >>> > > > > >> [2] to try to remove the product and received
an error:
>> >>> > > > > >>
>> >>> > > > > >> $ ./filemgr-client --deleteProductByName
--productName
>> >>> blah.txt
>> >>> > > --url
>> >>> > > > > >> http://localhost:9000
>> >>> > > > > >> .
>> >>> > > > > >> .
>> >>> > > > > >> ERROR: Failed to delete product
>> >>> > > > > >> 'org.apache.oodt.cas.filemgr.structs.Product@6cbc2704'
:
>> >>> > > > > >> org.apache.xmlrpc.XmlRpcException:
>> >>> > java.lang.NoSuchMethodException:
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> >>org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct(java.u
>> >>> > > > > >>til.Hashtable)
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > > >> It looks like it remove the file from the
archive but just
>> not
>> >>> > from
>> >>> > > > the
>> >>> > > > > >> catalog:
>> >>> > > > > >>
>> >>> > > > > >> $ ls /usr/local/oodt/cas-filemgr/files/blah.txt/
>> >>> > > > > >> total 0
>> >>> > > > > >> drwxr-xr-x+ 2 jpadams  staff    68B Feb
 6 19:31 ./
>> >>> > > > > >> drwxr-xr-x+ 3 jpadams  staff   102B Feb
 6 19:30 ../
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > > >> Any help on what is going on here would
be a great help!
>> >>> > > > > >>
>> >>> > > > > >> Quick minor bug note: The Filemgr User
Guide [1] references
>> >>> > > > 'query-tool'
>> >>> > > > > >> throughout, which should actually be 'query_tool'.
>> >>> > > > > >>
>> >>> > > > > >> [1]
>> >>> > > > > >>
>> >>> > > > >
>> >>> > >
>> >>>
>> https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide
>> >>> > > > > >> [2]
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quick+
>> >>> > > > > >>Start+Guide
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > > >> Thanks,
>> >>> > > > > >> Jordan
>> >>> > > > > >>
>> >>> > > > > >> --
>> >>> > > > > >> Jordan Padams
>> >>> > > > > >> Software Engineer
>> >>> > > > > >> NASA Jet Propulsion Laboratory
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> > >
>> >>> > >
>> >>> > > --
>> >>> > > *Lewis*
>> >>> > >
>> >>> >
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> *Lewis*
>> >>>
>> >>
>> >>
>> >>
>> >> --
>> >> Jordan Padams
>> >> Software Engineer
>> >> NASA Jet Propulsion Laboratory
>> >>
>> >
>> >
>> >
>> > --
>> > Jordan Padams
>> > Software Engineer
>> > NASA Jet Propulsion Laboratory
>> >
>>
>>
>>
>> --
>> Jordan Padams
>> Software Engineer
>> NASA Jet Propulsion Laboratory
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message