Return-Path: X-Original-To: apmail-oodt-dev-archive@www.apache.org Delivered-To: apmail-oodt-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 783D518682 for ; Thu, 4 Feb 2016 22:01:04 +0000 (UTC) Received: (qmail 38631 invoked by uid 500); 4 Feb 2016 22:01:04 -0000 Delivered-To: apmail-oodt-dev-archive@oodt.apache.org Received: (qmail 38597 invoked by uid 500); 4 Feb 2016 22:01:04 -0000 Mailing-List: contact dev-help@oodt.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@oodt.apache.org Delivered-To: mailing list dev@oodt.apache.org Received: (qmail 38581 invoked by uid 99); 4 Feb 2016 22:01:04 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Feb 2016 22:01:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 970F7185442 for ; Thu, 4 Feb 2016 22:01:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -1.229 X-Spam-Level: X-Spam-Status: No, score=-1.229 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-0.429, URI_NOVOWEL=0.5] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id PDxZypMYnSBz for ; Thu, 4 Feb 2016 22:01:00 +0000 (UTC) Received: from nat-mail5.med.umich.edu (nat-mail5.med.umich.edu [141.214.17.22]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 9A36424E24 for ; Thu, 4 Feb 2016 22:00:59 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.22,397,1449550800"; d="scan'208";a="54861558" Received: from unknown (HELO UHEXMBSPR05.umhs.med.umich.edu) ([10.30.18.45]) by nat-mail5.med.umich.edu with ESMTP/TLS/AES128-SHA; 04 Feb 2016 17:00:57 -0500 Received: from UHEXMBSPR12.umhs.med.umich.edu ([169.254.6.32]) by UHEXMBSPR05.umhs.med.umich.edu ([169.254.3.12]) with mapi id 14.03.0279.002; Thu, 4 Feb 2016 17:00:57 -0500 From: "Shi, Wei" To: "dev@oodt.apache.org" Subject: Re: filemgr-client script cannot delete product by id or name Thread-Topic: filemgr-client script cannot delete product by id or name Thread-Index: AdFescqPadpsNCSNT6GfYyTsY/rsCgAOBayAAACe/wAAAB4aAAAIeN2AABLOq5AAC5NwgAAAbrgAAAph8sD//7PzAIAASOGQ///FYICAAErmsP//yY6AgAACrQCAAEn54P//wOCAAAk1MYAAAu7RgAAPnzcA Date: Thu, 4 Feb 2016 22:00:56 +0000 Message-ID: References: <0401732D55BA3C44B5F18DFD7EECEB651CCBA493@UHEXMBSPR12.umhs.med.umich.edu> <0401732D55BA3C44B5F18DFD7EECEB651CCBA89A@UHEXMBSPR12.umhs.med.umich.edu> <0401732D55BA3C44B5F18DFD7EECEB651CCBA90B@UHEXMBSPR12.umhs.med.umich.edu> <0401732D55BA3C44B5F18DFD7EECEB651CCBA959@UHEXMBSPR12.umhs.med.umich.edu> <0401732D55BA3C44B5F18DFD7EECEB651CCBA9A1@UHEXMBSPR12.umhs.med.umich.edu> <0401732D55BA3C44B5F18DFD7EECEB651CCBAAD8@UHEXMBSPR12.umhs.med.umich.edu> <0401732D55BA3C44B5F18DFD7EECEB651CCBAB1F@UHEXMBSPR12.umhs.med.umich.edu> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.21.122.211] Content-Type: text/plain; charset="iso-8859-1" Content-ID: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi Lewis, I=B9ve signed up. My account is =B3shiwei=B2. But under =B3Create=B2 menu, = I have only =B3Create Service Desk Request=B2 option. On 2/4/16, 4:41 PM, "Lewis John Mcgibbney" wrote: >Hi Wei, >Can you please log these issues in Jira >https://issues.apache.org/jira/browse/OODT >It would be good if you could reference this thread from the mail archive >[0]. >We will try and get a fix going for this... and a test. >Lewis > >[0] http://www.mail-archive.com/dev%40oodt.apache.org/msg06562.html > >On Thu, Feb 4, 2016 at 11:28 AM, Shi, Wei wrote: > >> Tom, >> You are my hero! It works!! >> I notice that empty folders still stayed in archive folder, is that >>normal? >> >> Another thing I noticed: >> I have two different product type: GenericFile and MP3. There are two >> GenericFile Type files and two MP3 Type files. While I was getting the >> total number of the certain product type files, I always got the total. >> I use the following command: >> >> ./filemgr-client -op --getNumProducts --productTypeName GenericFile >>--url >> http://localhost:9000 >> ./filemgr-client -op --getNumProducts --productTypeName MP3 --url >> http://localhost:9000 >> >> Both returned 4 back to me. >> >> It seems to reflect the numbers returned from OPS UI interface. I have >>2 >> generic Files and 2 MP3 files, on screen it displayed: >> >> GenericFile (4) MP3 (4) >> >> Thanks, >> >> Wei >> >> -----Original Message----- >> From: Tom Barber [mailto:tom.barber@meteorite.bi] >> Sent: Thursday, February 04, 2016 1:42 PM >> To: dev@oodt.apache.org >> Subject: Re: filemgr-client script cannot delete product by id or name >> >> Ah sorry I thought you were building trunk after you asked about the >>tests. >> >> git clone the trunk code, there's only been my fixes and someone >>deleting >> a readme since we cut 0.11: https://github.com/apache/oodt >> >> Tom >> >> On Thu, Feb 4, 2016 at 6:38 PM, Shi, Wei wrote: >> >> > Hi Tom, >> > Do I download it from >> > http://www.apache.org/dyn/closer.cgi/oodt/apache-oodt-0.11-src.zip? >> > >> > I tried this one, same error. >> > >> > -----Original Message----- >> > From: Tom Barber [mailto:tom.barber@meteorite.bi] >> > Sent: Thursday, February 04, 2016 1:03 PM >> > To: dev@oodt.apache.org >> > Subject: Re: filemgr-client script cannot delete product by id or name >> > >> > Sorry ballsed that up, try again! :) >> > >> > On Thu, Feb 4, 2016 at 5:53 PM, Tom Barber >> > wrote: >> > >> > > Hi Wei >> > > >> > > Can you give it a pull and see if my fix got you working. >> > > >> > > Thanks >> > > >> > > Tom >> > > >> > > On Thu, Feb 4, 2016 at 5:14 PM, Shi, Wei >>wrote: >> > > >> > >> I am using Sprint STS 3.6.4(Eclipse Luna SR1 (4.4.2)), JDK >>1.7.0_75. >> > >> I imported oodt as a maven project >> > >> >> > >> >> > >> -----Original Message----- >> > >> From: Lewis John Mcgibbney [mailto:lewis.mcgibbney@gmail.com] >> > >> Sent: Thursday, February 04, 2016 11:40 AM >> > >> To: dev@oodt.apache.org >> > >> Subject: Re: filemgr-client script cannot delete product by id or >> > >> name >> > >> >> > >> Ok well this has to be environment specific. OODT tests have never >> > >> been that broken! >> > >> What environment e.g. platform, JDK, etc are you trying to compile >> > >> and test the code on? >> > >> Our integration builds over at builds.apache.org prove that the >> > >> code is compiling and testing in a clean build environment. >> > >> >> > >> On Thursday, February 4, 2016, Shi, Wei >>wrote: >> > >> >> > >> > Here is the summary of cas-filemgr compile result: >> > >> > >> > >> > Tests in error: >> > >> > TestDataSourceCatalog.testQuery:472 =BB Catalog >> > >> > TestLuceneCatalog.testGetReducedMetadata:213 =BB Catalog Unable >> > >> > to index product... >> > >> > TestLuceneCatalog.testGetMetadata:198 =BB Catalog Unable to ind= ex >> > >> product: >> > >> > [test... >> > >> > TestLuceneCatalog.testGetReducedMetadataNull:227 =BB Catalog >> > >> > Unable to index pro... >> > >> > TestMappedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 >> > >> > =BB >> > >> Catalog >> > >> > >> > >> > TestOrderedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 >> > >> > =BB Catalog >> > >> > >> > >> > TestTypeHandler.testGetCatalogAndOrigValuesAndGetCatalogQuery:217 >> > >> > =BB RepositoryManager >> > >> > TestXmlRpcStructFactory.testProductMethods:119 =BB >> > >> > RepositoryManager java.lang.E... >> > >> > TestXmlRpcStructFactory.testProductTypeMethods:82 =BB >> > >> > RepositoryManager java.lan... >> > >> > >> > >> > Tests run: 213, Failures: 72, Errors: 9, Skipped: 0 >> > >> > >> > >> > -----Original Message----- >> > >> > From: Tom Barber [mailto:tom.barber@meteorite.bi ] >> > >> > Sent: Thursday, February 04, 2016 10:49 AM >> > >> > To: dev@oodt.apache.org >> > >> > Subject: RE: filemgr-client script cannot delete product by id or >> > >> > name >> > >> > >> > >> > The tests always used to fail for me because for some reason they >> > >> > only compiled with the system clock not set to GMT! But I don't >> > >> > think that is your problem ;) what's the error? >> > >> > On 4 Feb 2016 3:29 pm, "Shi, Wei" > > >> > > >> > >> > wrote: >> > >> > >> > >> > > Separate question: >> > >> > > In order to compile it successfully, I have to skip tests. >> > >> > > Is there a way that I can also run tests successfully? >> > >> > > >> > >> > > -----Original Message----- >> > >> > > From: Tom Barber [mailto:tom.barber@meteorite.bi >> > >> > > ] >> > >> > > Sent: Thursday, February 04, 2016 10:24 AM >> > >> > > To: dev@oodt.apache.org >> > >> > > Subject: RE: filemgr-client script cannot delete product by id >> > >> > > or name >> > >> > > >> > >> > > Thinking more about it its probably a fudged xmlrpc mapping >> > >> > > which is why it still compiles. Joy! >> > >> > > >> > >> > > I'll get it fixed. >> > >> > > >> > >> > > Tom >> > >> > > On 4 Feb 2016 3:11 pm, "Tom Barber" > > >> > > wrote: >> > >> > > >> > >> > > > Hey Wei >> > >> > > > >> > >> > > > I'm just getting back from trip, when I reach my next hotel >> > >> > > > in an hour or so, I'll investigate properly for you. >> > >> > > > >> > >> > > > Tom >> > >> > > > On 4 Feb 2016 2:46 pm, "Shi, Wei" > > >> > > > > >> > >> > wrote: >> > >> > > > >> > >> > > >> Thank you Tom and Lewis. >> > >> > > >> >> > >> > > >> I've downloaded 0.11 source and compiled project >>cas-filemgr. >> > >> > > >> I unzipped cas-filemgr-0.11-dist.zip. >> > >> > > >> I was able to add products, but got same error while trying >> > >> > > >> to delete a product. >> > >> > > >> >> > >> > > >> Command: >> > >> > > >> ./filemgr-client -op --deleteProductById --productId >> > >> > > >> e36b0c35-1e3b-4f70-8c7e-d57826d8a052 --url >> > >> > > >> http://localhost:9000 >> > >> > > >> >> > >> > > >> Error: >> > >> > > >> ERROR: Failed to delete product >> > >> > > >> 'org.apache.oodt.cas.filemgr.structs.Product@1475d8e' : >> > >> > > >> org.apache.xmlrpc.XmlRpcException: >> > java.lang.NoSuchMethodException: >> > >> > > >> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeP >> > >> > > >> ro >> > >> > > >> duc >> > >> > > >> t( >> > >> > > >> ja >> > >> > > >> va.util.Hashtable) >> > >> > > >> >> > >> > > >> >> > >> > > >> Could that be caused by incorrect property settings? >> > >> > > >> >> > >> > > >> Wei >> > >> > > >> >> > >> > > >> -----Original Message----- >> > >> > > >> From: Tom Barber [mailto:magicaltrout@apache.org >> > >> > > >> ] >> > >> > > >> Sent: Wednesday, February 03, 2016 7:42 PM >> > >> > > >> To: Lewis John Mcgibbney >> > >> > > >> Cc: dev@oodt.apache.org >> > >> > > >> Subject: Re: filemgr-client script cannot delete product by >> > >> > > >> id or name >> > >> > > >> >> > >> > > >> There was a passing test I submitted in 0.11 to "ensure" the >> > >> > > >> deletion works, technically... its fine. >> > >> > > >> >> > >> > > >> Tom >> > >> > > >> >> > >> > > >> On Wed, Feb 3, 2016 at 8:39 PM, Lewis John Mcgibbney < >> > >> > > >> lewis.mcgibbney@gmail.com > wrote: >> > >> > > >> >> > >> > > >> > Thanks Tom. >> > >> > > >> > @Wei, >> > >> > > >> > I wonder if you can upgrade to OODT to 0.11 to try again? >> > >> > > >> > >> > >> > > >> > On Wed, Feb 3, 2016 at 12:35 PM, Tom Barber >> > >> > > >> > > >> > >> > > >> > wrote: >> > >> > > >> > >> > >> > > >> >> That is similar, but to me this looks like a jar file >> > >> > > >> >> mismatch because that error is a missing method, but the >> > >> > > >> >> method can't be missing, other wise it surely wouldn't >> > compile? >> > >> > > >> >> >> > >> > > >> >> Tom >> > >> > > >> >> >> > >> > > >> >> On Wed, Feb 3, 2016 at 8:17 PM, Lewis John Mcgibbney < >> > >> > > >> >> lewis.mcgibbney@gmail.com > wrote: >> > >> > > >> >> >> > >> > > >> >>> Tom, >> > >> > > >> >>> Is this issue not then one which was raised prior to the >> > >> > > >> >>> 0.11 >> > >> > > release? >> > >> > > >> >>> Lewis >> > >> > > >> >>> >> > >> > > >> >>> On Wed, Feb 3, 2016 at 10:54 AM, Shi, Wei >> > >> > > >> >>> > >> > >> > > >> wrote: >> > >> > > >> >>> >> > >> > > >> >>>> Hi, >> > >> > > >> >>>> I've setup an oodt test instance and followed "Solr >> > >> > > >> >>>> File Manger Quick Start Guide" to deployed Solr. >> > >> > > >> >>>> >> > >> > > >> >>>> Now I can ingest files and query data using Solr query >> > >> > > >> >>>> such >> > >> as: >> > >> > > >> >>>> http://localhost:8080/solr/select/?q=3D*:* >> > >> > > >> >>>> >> > >> > > >> >>>> The only problem I have is deleting a product. Neither >> > >> > > >> >>>> delete by id, nor delete by name works. >> > >> > > >> >>>> >> > >> > > >> >>>> After execution, the file in archive folder seems to be >> > >> > > >> >>>> deleted, but the folder is still there. All metadata >> > >> > > >> >>>> can still be seen via OPS UI interface. And the error >> > >> > > >> >>>> message >> > >> shows: >> > >> > > >> >>>> >> > >> > > >> >>>> ------------------- >> > >> > > >> >>>> ERROR: Failed to delete product >> > >> > > >> >>>> 'org.apache.oodt.cas.filemgr.structs.Product@a4fc7' : >> > >> > > >> >>>> java.lang.NoSuchMethodException: >> > >> > > >> >>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.re >> > >> > > >> >>>> mo >> > >> > > >> >>>> veP >> > >> > > >> >>>> ro >> > >> > > >> >>>> du >> > >> > > >> >>>> ct( >> > >> > > >> >>>> java.util.Hashtable) >> > >> > > >> >>>> -------------------- >> > >> > > >> >>>> >> > >> > > >> >>>> I double checked, cas-filemgr-0.10.jar file, which >> > >> > > >> >>>> should have class >> > >> > > >> >>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.re >> > >> > > >> >>>> mo veP ro du ct is in library folder. I also tried to >> > >> > > >> >>>> recompile version >> > >> > > >> >>>> 0.12 >> > >> > > >> (cas-filemgr-0.12-SNAPSHOT.jar), same error occurred. >> > >> > > >> >>>> >> > >> > > >> >>>> Can the files and metadata also be deleted manually via >> > >> > > >> >>>> command line interface? >> > >> > > >> >>>> >> > >> > > >> >>>> Any suggestion is appreciated, >> > >> > > >> >>>> >> > >> > > >> >>>> Wei Shi, M.B.A., M.S. >> > >> > > >> >>>> Architect >> > >> > > >> >>>> UM Comprehensive Cancer Center NCRC 100/134 >> > >> > > >> >>>> O: 734-763-8440 C: 248-835-8453 shiwei@med.umich.edu >> > >> > >> > >> > > >> >>>> >> > >> > > >> >>>> >> > >> > > >> >>>> >> > >> > > >> >>>> ******************************************************* >> > >> > > >> >>>> ** >> > >> > > >> >>>> * Electronic Mail is not secure, may not be read every >> > >> > > >> >>>> day, and should not be used for urgent or sensitive >> > >> > > >> >>>> issues >> > >> > > >> >>>> >> > >> > > >> >>> >> > >> > > >> >>> >> > >> > > >> >>> >> > >> > > >> >>> -- >> > >> > > >> >>> *Lewis* >> > >> > > >> >>> >> > >> > > >> >> >> > >> > > >> >> >> > >> > > >> > >> > >> > > >> > >> > >> > > >> > -- >> > >> > > >> > *Lewis* >> > >> > > >> > >> > >> > > >> ********************************************************** >> > >> > > >> Electronic Mail is not secure, may not be read every day, >> > >> > > >> and should not be used for urgent or sensitive issues >> > >> > > >> >> > >> > > > >> > >> > > ********************************************************** >> > >> > > Electronic Mail is not secure, may not be read every day, and >> > >> > > should not be used for urgent or sensitive issues >> > >> > > >> > >> > ********************************************************** >> > >> > Electronic Mail is not secure, may not be read every day, and >> > >> > should not be used for urgent or sensitive issues >> > >> > >> > >> >> > >> >> > >> -- >> > >> *Lewis* >> > >> ********************************************************** >> > >> Electronic Mail is not secure, may not be read every day, and >> > >> should not be used for urgent or sensitive issues >> > >> >> > > >> > > >> > ********************************************************** >> > Electronic Mail is not secure, may not be read every day, and should >> > not be used for urgent or sensitive issues >> > >> ********************************************************** >> Electronic Mail is not secure, may not be read every day, and should not >> be used for urgent or sensitive issues >> > > > >-- = >*Lewis* ********************************************************** Electronic Mail is not secure, may not be read every day, and should not be= used for urgent or sensitive issues=20