oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Mattmann <chris.mattm...@gmail.com>
Subject Re: HttpClient NoClassDefFoundError For the url-downloader Script of the Apache OODT Crawler
Date Wed, 08 Oct 2014 18:36:31 GMT
Yep woot! Committed!

------------------------
Chris Mattmann
chris.mattmann@gmail.com




-----Original Message-----
From: Lewis John Mcgibbney <lewis.mcgibbney@gmail.com>
Reply-To: <dev@oodt.apache.org>
Date: Thursday, October 9, 2014 at 12:01 AM
To: MengYing Wang <mengyingwang1@gmail.com>
Cc: Chris Mattmann <Chris.A.Mattmann@jpl.nasa.gov>, Paul M Ramirez
<paul.m.ramirez@jpl.nasa.gov>, "dev@oodt.apache.org" <dev@oodt.apache.org>
Subject: Re: HttpClient NoClassDefFoundError For the url-downloader Script
of the Apache OODT Crawler

>Dynamite Angela.
>Thanks for your persistence.
>
>On Sat, Oct 4, 2014 at 8:22 PM, MengYing Wang <mengyingwang1@gmail.com>
>wrote:
>
>> Dear Lewis,
>>
>> Done. This is the jira url:
>>https://issues.apache.org/jira/browse/OODT-756
>>
>> Best,
>> Mengying Wang
>>
>> On Tue, Sep 30, 2014 at 6:59 PM, Lewis John Mcgibbney <
>> lewis.mcgibbney@gmail.com> wrote:
>>
>>> Ok it sounds like we need to file an issue for this.
>>> Can you possibly of an issue in Jira?
>>> If someone else can reproduce then it is a bug which we need to fix.
>>> Thank you
>>> Lewis
>>>
>>>
>>> On Tuesday, September 30, 2014, MengYing Wang <mengyingwang1@gmail.com>
>>> wrote:
>>>
>>>> Dear Lewis,
>>>>
>>>> By the way, no need to change any code in the script url-downloader.
>>>>
>>>> Thank you.
>>>>
>>>> Best,
>>>> Angela Wang
>>>>
>>>> On Tue, Sep 30, 2014 at 1:29 PM, MengYing Wang
>>>><mengyingwang1@gmail.com>
>>>> wrote:
>>>>
>>>>> Dear Lewis,
>>>>>
>>>>> The problem has been solved! *~*
>>>>>
>>>>> I just noticed that the class
>>>>> org.apache.oodt.cas.pushpull.protocol.http.HttpClient does exist in
>>>>> cas-pushpull-0.2.jar, but disappeared in cas-pushpull-0.6 (Why?). So
>>>>>I just
>>>>> downloaded the cas-pushpull-0.2.jar file from
>>>>> http://www.java2s.com/Code/Jar/c/Downloadcaspushpull02jar.htm, and
>>>>> threw it into my pushpull lib directory. Then I can start the
>>>>> url-downloader script normally. Thank you!
>>>>>
>>>>> Best,
>>>>> Angela Wang
>>>>>
>>>>> On Tue, Sep 30, 2014 at 8:28 AM, Lewis John Mcgibbney <
>>>>> lewis.mcgibbney@gmail.com> wrote:
>>>>>
>>>>>> Hi Angela,
>>>>>> If this is a change against the code base and you think that is an
>>>>>> improvement can you possibly log an issue in our issue tracking
>>>>>>system?
>>>>>>
>>>>>>
>>>>>> 
>>>>>>https://issues.apache.org/jira/browse/OODT/?selectedTab=com.atlassian
>>>>>>.jira.jira-projects-plugin:summary-panel
>>>>>>
>>>>>> The usual process is to create a Jira account, log in, create an
>>>>>>issue.
>>>>>> We would encourage you to be as verbose as possible when logging
>>>>>> issues. It really helps to describe what was wrong, how it can be
>>>>>> reproduced and what your suggested fix is.
>>>>>>
>>>>>> If you are able to attach a patch for fixing the issue then this
is
>>>>>> the cherry on the cake.
>>>>>> Thanks
>>>>>> Lewis
>>>>>>
>>>>>> On Monday, September 29, 2014, MengYing Wang
>>>>>><mengyingwang1@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Dear Lewis,
>>>>>>>
>>>>>>> Thank you for your help. I have modified the url-downloader script
>>>>>>> to add all jar files into the classpath. Following is the new
>>>>>>>content.
>>>>>>>
>>>>>>>
>>>>>>> 
>>>>>>>--------------------------------------------------------------------
>>>>>>>----------------------------------
>>>>>>>
>>>>>>> set LIB_DEPS
>>>>>>>
>>>>>>> foreach file (`find ../lib/*.jar`)
>>>>>>>
>>>>>>>      set LIB_DEPS = "${file}:${LIB_DEPS}"
>>>>>>>
>>>>>>> end
>>>>>>>
>>>>>>>
>>>>>>> set
>>>>>>> 
>>>>>>>JAVA_HOME="/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Conten
>>>>>>>ts/Home"
>>>>>>>
>>>>>>>
>>>>>>> ${JAVA_HOME}/bin/java -cp ${LIB_DEPS} -Djava.ext.dirs=../lib
\
>>>>>>>
>>>>>>>         -Djava.util.logging.config.file=../etc/logging.properties
\
>>>>>>>
>>>>>>>         org.apache.oodt.cas.pushpull.protocol.http.HttpClient
\
>>>>>>>
>>>>>>>         --url $1 \
>>>>>>>
>>>>>>>         --downloadToDir $2
>>>>>>>
>>>>>>>
>>>>>>> 
>>>>>>>--------------------------------------------------------------------
>>>>>>>----------------------------------
>>>>>>>
>>>>>>>
>>>>>>> Thank you!
>>>>>>>
>>>>>>>
>>>>>>> Best,
>>>>>>>
>>>>>>> Angela Wang
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Sep 29, 2014 at 12:52 AM, Lewis John Mcgibbney <
>>>>>>> lewis.mcgibbney@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Angela,
>>>>>>>> The problem is pretty straight forward to address.
>>>>>>>> The offending classes are not present on your classpath at
>>>>>>>>runtime...
>>>>>>>> Can you maybe explain how you added all of the jar's in lib
to
>>>>>>>>your
>>>>>>>> classpath?
>>>>>>>> Thanks, we will get there eventually.
>>>>>>>> Thank you
>>>>>>>> Lewis
>>>>>>>>
>>>>>>>> On Sun, Sep 28, 2014 at 11:10 PM, AngelaWang <
>>>>>>>> mengyingwang1@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Dear Prof. Mattmann,
>>>>>>>>>
>>>>>>>>> Sorry for the late response, since I just join the mailing
list.
>>>>>>>>> Following are the jar files that are in my $PUSHPULL_HOME/lib
>>>>>>>>>directory:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 
>>>>>>>>>------------------------------------------------------------------
>>>>>>>>>------------------------------------------------------------------
>>>>>>>>>--
>>>>>>>>> antlr-2.7.6.jar ehcache-1.2.3.jar solr-commons-csv-1.3.0.jar
>>>>>>>>> aopalliance-1.0.jar fontbox-1.3.1.jar solr-core-1.3.0.jar
>>>>>>>>> asm-3.1.jar geronimo-activation_1.1_spec-1.1.jar
>>>>>>>>> solr-lucene-analyzers-1.3.0.jar
>>>>>>>>> asm-attrs-1.5.3.jar geronimo-javamail_1.4_mail-1.8.1.jar
>>>>>>>>> solr-lucene-highlighter-1.3.0.jar
>>>>>>>>> bcmail-jdk15-1.45.jar geronimo-stax-api_1.0_spec-1.0.1.jar
>>>>>>>>> solr-lucene-queries-1.3.0.jar
>>>>>>>>> bcprov-jdk15-1.45.jar guava-10.0.1.jar
>>>>>>>>> solr-lucene-snowball-1.3.0.jar
>>>>>>>>> boilerpipe-1.1.0.jar hibernate-3.2.5.ga.jar
>>>>>>>>> solr-lucene-spellchecker-1.3.0.jar
>>>>>>>>> cas-cli-0.6.jar hsqldb-1.8.0.7.jar solr-solrj-1.3.0.jar
>>>>>>>>> cas-filemgr-0.6.jar jdom-1.0.jar spring-aop-3.0.5.RELEASE.jar
>>>>>>>>> cas-metadata-0.6.jar jempbox-1.3.1.jar
>>>>>>>>>spring-asm-3.0.5.RELEASE.jar
>>>>>>>>> cas-protocol-api-0.6.jar jsch-0.1.42.jar
>>>>>>>>> spring-beans-3.0.5.RELEASE.jar
>>>>>>>>> cas-protocol-ftp-0.6.jar jsr305-1.3.9.jar
>>>>>>>>> spring-context-3.0.5.RELEASE.jar
>>>>>>>>> cas-protocol-http-0.6.jar jug-2.0.0-asl.jar
>>>>>>>>> spring-core-3.0.5.RELEASE.jar
>>>>>>>>> cas-protocol-imaps-0.6.jar junit-3.8.2.jar spring-dao-2.0.8.jar
>>>>>>>>> cas-protocol-sftp-0.6.jar jython-2.2-beta1.jar
>>>>>>>>> spring-expression-3.0.5.RELEASE.jar
>>>>>>>>> cas-pushpull-0.6.jar lucene-core-2.0.0.jar
>>>>>>>>> spring-hibernate3-2.0.8.jar
>>>>>>>>> cglib-2.1_3.jar metadata-extractor-2.4.0-beta-1.jar
>>>>>>>>> spring-jdbc-2.0.8.jar
>>>>>>>>> cog-jglobus-1.8.0.jar mina-core-2.0.4.jar stax-1.2.0.jar
>>>>>>>>> commons-cli-1.2.jar nekohtml-1.9.6.2.jar stax-api-1.0.1.jar
>>>>>>>>> commons-codec-1.3.jar netcdf-4.2.jar stax-utils-20040917.jar
>>>>>>>>> commons-collections-2.1.jar oodt-commons-0.6.jar tagsoup-1.2.jar
>>>>>>>>> commons-compress-1.1.jar oro-2.0.8.jar tika-core-0.8.jar
>>>>>>>>> commons-dbcp-1.2.1.jar pcs-input-0.6.jar tika-parsers-0.8.jar
>>>>>>>>> commons-fileupload-1.2.jar pdfbox-1.3.1.jar xercesImpl-2.9.1.jar
>>>>>>>>> commons-httpclient-3.0.jar poi-3.7.jar xml-apis-1.0.b2.jar
>>>>>>>>> commons-io-1.4.jar poi-ooxml-3.7.jar xmlbeans-2.3.0.jar
>>>>>>>>> commons-lang-2.3.jar poi-ooxml-schemas-3.7.jar xmlrpc-2.0.1.jar
>>>>>>>>> commons-logging-1.0.3.jar poi-scratchpad-3.7.jar
>>>>>>>>> xpp3_min-1.1.4c.jar
>>>>>>>>> commons-net-1.4.0.jar rome-0.9.jar xstream-1.3.1.jar
>>>>>>>>> commons-pool-1.2.jar slf4j-api-1.6.1.jar
>>>>>>>>> dom4j-1.6.1.jar solr-common-1.3.0.jar
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 
>>>>>>>>>------------------------------------------------------------------
>>>>>>>>>------------------------------------------------------------------
>>>>>>>>>--
>>>>>>>>>
>>>>>>>>> @Lewis, the version of oodt is 0.6. I have added the
the
>>>>>>>>> commons-httpclient library to the Pom.xml file (which
is in the
>>>>>>>>>pushpull
>>>>>>>>> directory) and rebuild the pushpull module using maven.
Still I
>>>>>>>>>get the
>>>>>>>>> same error.
>>>>>>>>>
>>>>>>>>> @Paul, I also tried to add all the jar files in the lib
directory
>>>>>>>>> to the classpath, Still the same error. Also I am running
>>>>>>>>> the url-downloader script from the cas-pushpull/bin directory.
>>>>>>>>>
>>>>>>>>> Thank you for your help!
>>>>>>>>>
>>>>>>>>> Best,
>>>>>>>>> Angela Wang
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *Lewis*
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Best,
>>>>>>> Mengying (Angela) Wang
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Lewis*
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best,
>>>>> Mengying (Angela) Wang
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Best,
>>>> Mengying (Angela) Wang
>>>>
>>>
>>>
>>> --
>>> *Lewis*
>>>
>>>
>>
>>
>> --
>> Best,
>> Mengying (Angela) Wang
>>
>
>
>
>-- 
>*Lewis*



Mime
View raw message