Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A56B310BCE for ; Mon, 10 Jun 2013 15:01:11 +0000 (UTC) Received: (qmail 29547 invoked by uid 500); 10 Jun 2013 15:01:05 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 29400 invoked by uid 500); 10 Jun 2013 15:01:05 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 29245 invoked by uid 99); 10 Jun 2013 15:01:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Jun 2013 15:01:05 +0000 X-ASF-Spam-Status: No, hits=1.6 required=5.0 tests=ASF_LIST_SERVER_DEV_B,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [209.85.212.48] (HELO mail-vb0-f48.google.com) (209.85.212.48) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Jun 2013 15:01:01 +0000 Received: by mail-vb0-f48.google.com with SMTP id w15so2218308vbf.35 for ; Mon, 10 Jun 2013 08:00:20 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:x-gm-message-state; bh=/32Rz00KehwhI+w3VATBir7XZjYJhnWpIdsQWzsldi8=; b=HSarG7U578dKeWlWLnSNfY/fKSpXT6p+t33oJ/IvwI2E4X8OgwtFegHcfZy4RVJoQw Le0CWNvbAjKtwKX74lkScsseaDPxEL7khdjVQuYe7q3pjbJwA12pgYNfobaIfdDcsOgb 5p5VM9yVkbK0q/+9C7ypiOqTKAibFKBDcGFiQtShD7Z0JFg1UGAWgqYu/TEZm/ur4Xjm rB+HXgBY+YW4FsBTHDh/2XtHi68O5Ds6Jp8ps9HN5W0f/tjnvEQz+XhaK15OGDReOrNt wsKeldMuGVEsA4f2ZOpjxLAHyGKdS2izdsygXwA5xwHaJydxa8xP9mzZ9BRReIBO8pcX DmKw== X-Received: by 10.52.170.148 with SMTP id am20mr4949426vdc.75.1370876419751; Mon, 10 Jun 2013 08:00:19 -0700 (PDT) MIME-Version: 1.0 Received: by 10.220.116.16 with HTTP; Mon, 10 Jun 2013 07:59:59 -0700 (PDT) In-Reply-To: References: From: Michael Della Bitta Date: Mon, 10 Jun 2013 10:59:59 -0400 Message-ID: Subject: Re: Solr 4.3.0 Cloud Issue indexing pdf documents To: Mark Wilson Cc: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=e89a8ffba20d08040404dece0a87 X-Gm-Message-State: ALoCoQk/qmsH5dAq+HgzPC676TAIwaw3mUROypXL2blH/RteA6/0tB3or/g7NF4r8byhrR1VXDr0 X-Virus-Checked: Checked by ClamAV on apache.org --e89a8ffba20d08040404dece0a87 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Glad that helped. I'm going to go buy a lottery ticket now! :) Michael Della Bitta Applications Developer o: +1 646 532 3062 | c: +1 917 477 7906 appinions inc. =93The Science of Influence Marketing=94 18 East 41st Street New York, NY 10017 t: @appinions | g+: plus.google.com/appinions w: appinions.com On Mon, Jun 10, 2013 at 5:56 AM, Mark Wilson wrote: > Hi Michael > > Thanks very much for that, it did indeed solve the problem. > > I had it setup on my internal servers, as I have a separate script for > tomcat startup, but forgot all about it on the Amazon Cloud servers. > > For info > > I added > CATALINA_OPTS=3D"-Djava.awt.headless=3Dtrue" > export CATALINA_OPTS > > to $tomcat_home/bin/setenv.sh > > Thanks again > > Regards Mark > > > On 07/06/2013 19:29, "Michael Della Bitta" > wrote: > > > Hi Mark, > > > > This is a total shot in the dark, but does > > passing -Djava.awt.headless=3Dtrue when you run the server help at all= ? > > > > More on awt headless mode: > > http://www.oracle.com/technetwork/articles/javase/headless-136834.html > > > > Michael Della Bitta > > > > Applications Developer > > > > o: +1 646 532 3062 | c: +1 917 477 7906 > > > > appinions inc. > > > > =93The Science of Influence Marketing=94 > > > > 18 East 41st Street > > > > New York, NY 10017 > > > > t: @appinions | g+: > > plus.google.com/appinions > > w: appinions.com > > > > > > On Fri, Jun 7, 2013 at 11:31 AM, Mark Wilson wrote: > > > >> Hi > >> > >> I am having an issue with adding pdf documents to a SolrCloud index I > have > >> setup. > >> > >> I can index pdf documents fine using 4.3.0 on my local box, but I have= a > >> SolrCloud instance setup on the Amazon Cloud (Using 2 servers) and I g= et > >> Error. > >> > >> It seems that it is not loading org.apache.pdfbox.pdmodel.PDPage. > However, > >> the jar is in the directory, and referenced in the solrconfig.xml file > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> When I start Tomcat, I can see that the file has loaded. > >> > >> 2705 [coreLoadExecutor-4-thread-3] INFO > >> org.apache.solr.core.SolrResourceLoader =AD Adding > >> 'file:/www/solr/lib/contrib/extraction/lib/pdfbox-1.7.1.jar' to > classloader > >> > >> But when I try to add a document. > >> > >> java > >> -Durl=3D > >> http://ec2-blah-blaheu-west-1.compute.amazonaws.com:8080/solr/quosa2-c > >> ollection/update/extract -Dparams=3Dliteral.id=3Dpdf1 -Dtype=3Dtext/pd= f -jar > >> post.jar 2008.Genomics.pdf > >> > >> > >> I get this error. I=B9m running on an Ubuntu machine. > >> > >> Linux ip-10-229-125-163 3.5.0-21-generic #32-Ubuntu SMP Tue Dec 11 > 18:51:59 > >> UTC 2012 x86_64 x86_64 x86_64 GNU/Linux > >> > >> Error log. > >> > >> 88168 [http-bio-8080-exec-1] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard1_replica1] webapp=3D/solr path=3D/update/extr= act > >> params=3D{literal.id=3Dpdf1} {} 0 1534 > >> 88180 [http-bio-8080-exec-1] ERROR > >> org.apache.solr.servlet.SolrDispatchFilter =AD > >> null:java.lang.RuntimeException: java.lang.UnsatisfiedLinkError: > >> /usr/lib/jvm/java-7-oracle/jre/lib/amd64/xawt/libmawt.so: > libXrender.so.1: > >> cannot open shared object file: No such file or directory > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.j= ava > >> :670) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja= va: > >> 380) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja= va: > >> 155) > >> at > >> > >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicat= ion > >> FilterChain.java:243) > >> at > >> > >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilte= rCh > >> ain.java:210) > >> at > >> > >> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve= .ja > >> va:222) > >> at > >> > >> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve= .ja > >> va:123) > >> at > >> > >> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:= 171 > >> ) > >> at > >> > >> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:= 99) > >> at > >> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947) > >> at > >> > >> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.j= ava > >> :118) > >> at > >> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:40= 8) > >> at > >> > >> > org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Pr= oce > >> ssor.java:1009) > >> at > >> > >> > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abst= rac > >> tProtocol.java:589) > >> at > >> > >> > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.ja= va: > >> 310) > >> at > >> > >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java= :11 > >> 45) > >> at > >> > >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:6 > >> 15) > >> at java.lang.Thread.run(Thread.java:722) > >> Caused by: java.lang.UnsatisfiedLinkError: > >> /usr/lib/jvm/java-7-oracle/jre/lib/amd64/xawt/libmawt.so: > libXrender.so.1: > >> cannot open shared object file: No such file or directory > >> at java.lang.ClassLoader$NativeLibrary.load(Native Method) > >> at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1939) > >> at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1864) > >> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1825) > >> at java.lang.Runtime.load0(Runtime.java:792) > >> at java.lang.System.load(System.java:1059) > >> at java.lang.ClassLoader$NativeLibrary.load(Native Method) > >> at java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1939) > >> at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1864) > >> at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1846) > >> at java.lang.Runtime.loadLibrary0(Runtime.java:845) > >> at java.lang.System.loadLibrary(System.java:1084) > >> at > sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:67) > >> at > sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:47) > >> at java.security.AccessController.doPrivileged(Native Method) > >> at java.awt.Toolkit.loadLibraries(Toolkit.java:1648) > >> at java.awt.Toolkit.(Toolkit.java:1670) > >> at java.awt.Color.(Color.java:275) > >> at org.apache.pdfbox.pdmodel.PDPage.(PDPage.java:72) > >> at > org.apache.pdfbox.pdmodel.PDPageNode.getAllKids(PDPageNode.java:212) > >> at > org.apache.pdfbox.pdmodel.PDPageNode.getAllKids(PDPageNode.java:184) > >> at > >> > >> > org.apache.pdfbox.pdmodel.PDDocumentCatalog.getAllPages(PDDocumentCatalog= .ja > >> va:211) > >> at > >> > org.apache.pdfbox.util.PDFTextStripper.writeText(PDFTextStripper.java:328= ) > >> at org.apache.tika.parser.pdf.PDF2XHTML.process(PDF2XHTML.java:72) > >> at org.apache.tika.parser.pdf.PDFParser.parse(PDFParser.java:153) > >> at > >> org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:242) > >> at > >> org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:242) > >> at > >> org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:12= 0) > >> at > >> > >> > org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(Extracti= ngD > >> ocumentLoader.java:219) > >> at > >> > >> > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(Conten= tSt > >> reamHandlerBase.java:74) > >> at > >> > >> > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBa= se. > >> java:135) > >> at > >> > >> > org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequ= est > >> (RequestHandlers.java:242) > >> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1816) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.jav= a:6 > >> 56) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja= va: > >> 359) > >> ... 16 more > >> > >> 88234 [http-bio-8080-exec-2] INFO org.apache.solr.update.UpdateHandle= r > =AD > >> start > >> > >> > commit{,optimize=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeD= eletes=3Dfa > >> lse,softCommit=3Dfalse,prepareCommit=3Dfalse} > >> 88268 [http-bio-8080-exec-2] INFO org.apache.solr.core.SolrCore =AD > >> SolrDeletionPolicy.onCommit: commits:num=3D2 > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard1_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7b2d9e10; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_15,generation=3D41,filenames=3D[se= gments_15] > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard1_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7b2d9e10; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_16,generation=3D42,filenames=3D[se= gments_16] > >> 88268 [http-bio-8080-exec-2] INFO org.apache.solr.core.SolrCore =AD > newest > >> commit =3D 42[segments_16] > >> 88269 [http-bio-8080-exec-2] INFO > org.apache.solr.search.SolrIndexSearcher > >> =AD Opening Searcher@6175f8cb main > >> 88270 [searcherExecutor-6-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> QuerySenderListener sending requests to Searcher@6175f8cb > >> main{StandardDirectoryReader(segments_15:9:nrt)} > >> 88271 [searcherExecutor-6-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> QuerySenderListener done. > >> 88273 [searcherExecutor-6-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> [quosa2-collection_shard1_replica1] Registered new searcher > >> Searcher@6175f8cb main{StandardDirectoryReader(segments_15:9:nrt)} > >> 88273 [http-bio-8080-exec-2] INFO org.apache.solr.update.UpdateHandle= r > =AD > >> end_commit_flush > >> 88288 [http-bio-8080-exec-2] INFO > >> org.apache.solr.update.SolrCmdDistributor > >> =AD Distrib commit to:[StdNode: > >> http://10.234.215.24:8080/solr/quosa2-collection_shard1_replica3/, > >> StdNode: > >> http://10.229.125.163:8080/solr/quosa2-collection_shard2_replica1/, > >> StdNode: > >> http://10.234.215.24:8080/solr/quosa2-collection_shard2_replica3/, > >> StdNode: > >> http://10.229.125.163:8080/solr/quosa2-collection_shard3_replica1/, > >> StdNode: > >> http://10.234.215.24:8080/solr/quosa2-collection_shard3_replica3/] > >> > >> > params:commit_end_point=3Dtrue&commit=3Dtrue&softCommit=3Dfalse&waitSearc= her=3Dtrue& > >> expungeDeletes=3Dfalse > >> 88321 [http-bio-8080-exec-3] INFO org.apache.solr.update.UpdateHandle= r > =AD > >> start > >> > >> > commit{,optimize=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeD= eletes=3Dfa > >> lse,softCommit=3Dfalse,prepareCommit=3Dfalse} > >> 88334 [http-bio-8080-exec-4] INFO org.apache.solr.update.UpdateHandle= r > =AD > >> start > >> > >> > commit{,optimize=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeD= eletes=3Dfa > >> lse,softCommit=3Dfalse,prepareCommit=3Dfalse} > >> 88351 [http-bio-8080-exec-3] INFO org.apache.solr.core.SolrCore =AD > >> SolrDeletionPolicy.onCommit: commits:num=3D2 > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard2_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7d5549ce; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_19,generation=3D45,filenames=3D[se= gments_19] > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard2_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7d5549ce; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_1a,generation=3D46,filenames=3D[se= gments_1a] > >> 88354 [http-bio-8080-exec-3] INFO org.apache.solr.core.SolrCore =AD > newest > >> commit =3D 46[segments_1a] > >> 88357 [http-bio-8080-exec-3] INFO > org.apache.solr.search.SolrIndexSearcher > >> =AD Opening Searcher@775f6084 main > >> 88360 [http-bio-8080-exec-4] INFO org.apache.solr.core.SolrCore =AD > >> SolrDeletionPolicy.onCommit: commits:num=3D2 > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard3_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@782256a2; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_19,generation=3D45,filenames=3D[se= gments_19] > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard3_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@782256a2; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_1a,generation=3D46,filenames=3D[se= gments_1a] > >> 88362 [http-bio-8080-exec-4] INFO org.apache.solr.core.SolrCore =AD > newest > >> commit =3D 46[segments_1a] > >> 88363 [http-bio-8080-exec-4] INFO > org.apache.solr.search.SolrIndexSearcher > >> =AD Opening Searcher@4a2415c5 main > >> 88364 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> QuerySenderListener sending requests to Searcher@4a2415c5 > >> main{StandardDirectoryReader(segments_19:1:nrt)} > >> 88365 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> QuerySenderListener done. > >> 88367 [searcherExecutor-5-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> [quosa2-collection_shard3_replica1] Registered new searcher > >> Searcher@4a2415c5 main{StandardDirectoryReader(segments_19:1:nrt)} > >> 88367 [http-bio-8080-exec-4] INFO org.apache.solr.update.UpdateHandle= r > =AD > >> end_commit_flush > >> 88368 [searcherExecutor-7-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> QuerySenderListener sending requests to Searcher@775f6084 > >> main{StandardDirectoryReader(segments_19:1:nrt)} > >> 88368 [searcherExecutor-7-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> QuerySenderListener done. > >> 88367 [http-bio-8080-exec-4] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard3_replica1] webapp=3D/solr path=3D/update > >> > >> > params=3D{waitSearcher=3Dtrue&commit=3Dtrue&wt=3Djavabin&expungeDeletes= =3Dfalse&commit > >> _end_point=3Dtrue&version=3D2&softCommit=3Dfalse} {commit=3D} 0 33 > >> 88371 [http-bio-8080-exec-3] INFO org.apache.solr.update.UpdateHandle= r > =AD > >> end_commit_flush > >> 88370 [searcherExecutor-7-thread-1] INFO org.apache.solr.core.SolrCor= e > =AD > >> [quosa2-collection_shard2_replica1] Registered new searcher > >> Searcher@775f6084 main{StandardDirectoryReader(segments_19:1:nrt)} > >> 88376 [http-bio-8080-exec-3] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard2_replica1] webapp=3D/solr path=3D/update > >> > >> > params=3D{waitSearcher=3Dtrue&commit=3Dtrue&wt=3Djavabin&expungeDeletes= =3Dfalse&commit > >> _end_point=3Dtrue&version=3D2&softCommit=3Dfalse} {commit=3D} 0 55 > >> 88379 [http-bio-8080-exec-2] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard1_replica1] webapp=3D/solr path=3D/update/extr= act > >> params=3D{commit=3Dtrue&literal.id=3Dpdf1} {commit=3D} 0 149 > >> > >> > >> When I try to add the file again, I get another error. > >> > >> SimplePostTool version 1.5 > >> Posting files to base url > >> > http://server:8080/solr/quosa2-collection/update/extract?literal.id=3Dpdf= 1 > >> using content-type text/pdf.. > >> POSTing file 2008.Genomics.pdf > >> SimplePostTool: WARNING: Solr returned an error #500 Internal Server > Error > >> SimplePostTool: WARNING: IOException while reading response: > >> java.io.IOException: Server returned HTTP response code: 500 for URL: > >> > >> > http://ec2-54-228-131-56.eu-west-1.compute.amazonaws.com:8080/solr/quosa2= -co > >> llection/update/extract?literal.id=3Dpdf1 > >> 1 files indexed. > >> COMMITting Solr index changes to > >> > >> > http://ec2-54-228-131-56.eu-west-1.compute.amazonaws.com:8080/solr/quosa2= -co > >> llection/update/extract?literal.id=3Dpdf1.. > >> Time spent: 0:00:00.341 > >> > >> Error Log > >> > >> 731088 [http-bio-8080-exec-8] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard1_replica1] webapp=3D/solr path=3D/update/extr= act > >> params=3D{literal.id=3Dpdf1} {} 0 170 > >> 731094 [http-bio-8080-exec-8] ERROR > >> org.apache.solr.servlet.SolrDispatchFilter =AD > >> null:java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could > not > >> initialize class org.apache.pdfbox.pdmodel.PDPage > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.j= ava > >> :670) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja= va: > >> 380) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja= va: > >> 155) > >> at > >> > >> > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicat= ion > >> FilterChain.java:243) > >> at > >> > >> > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilte= rCh > >> ain.java:210) > >> at > >> > >> > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve= .ja > >> va:222) > >> at > >> > >> > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve= .ja > >> va:123) > >> at > >> > >> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:= 171 > >> ) > >> at > >> > >> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:= 99) > >> at > >> > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947) > >> at > >> > >> > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.j= ava > >> :118) > >> at > >> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:40= 8) > >> at > >> > >> > org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Pr= oce > >> ssor.java:1009) > >> at > >> > >> > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abst= rac > >> tProtocol.java:589) > >> at > >> > >> > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.ja= va: > >> 310) > >> at > >> > >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java= :11 > >> 45) > >> at > >> > >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:6 > >> 15) > >> at java.lang.Thread.run(Thread.java:722) > >> Caused by: java.lang.NoClassDefFoundError: Could not initialize class > >> org.apache.pdfbox.pdmodel.PDPage > >> at > org.apache.pdfbox.pdmodel.PDPageNode.getAllKids(PDPageNode.java:212) > >> at > org.apache.pdfbox.pdmodel.PDPageNode.getAllKids(PDPageNode.java:184) > >> at > >> > >> > org.apache.pdfbox.pdmodel.PDDocumentCatalog.getAllPages(PDDocumentCatalog= .ja > >> va:211) > >> at > >> > org.apache.pdfbox.util.PDFTextStripper.writeText(PDFTextStripper.java:328= ) > >> at org.apache.tika.parser.pdf.PDF2XHTML.process(PDF2XHTML.java:72) > >> at org.apache.tika.parser.pdf.PDFParser.parse(PDFParser.java:153) > >> at > >> org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:242) > >> at > >> org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:242) > >> at > >> org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:12= 0) > >> at > >> > >> > org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(Extracti= ngD > >> ocumentLoader.java:219) > >> at > >> > >> > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(Conten= tSt > >> reamHandlerBase.java:74) > >> at > >> > >> > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBa= se. > >> java:135) > >> at > >> > >> > org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequ= est > >> (RequestHandlers.java:242) > >> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1816) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.jav= a:6 > >> 56) > >> at > >> > >> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja= va: > >> 359) > >> ... 16 more > >> > >> 731110 [http-bio-8080-exec-9] INFO > org.apache.solr.update.UpdateHandler =AD > >> start > >> > >> > commit{,optimize=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeD= eletes=3Dfa > >> lse,softCommit=3Dfalse,prepareCommit=3Dfalse} > >> 731143 [http-bio-8080-exec-9] INFO org.apache.solr.core.SolrCore =AD > >> SolrDeletionPolicy.onCommit: commits:num=3D2 > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard1_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7b2d9e10; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_16,generation=3D42,filenames=3D[se= gments_16] > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard1_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7b2d9e10; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_17,generation=3D43,filenames=3D[se= gments_17] > >> 731144 [http-bio-8080-exec-9] INFO org.apache.solr.core.SolrCore =AD > newest > >> commit =3D 43[segments_17] > >> 731145 [http-bio-8080-exec-9] INFO > >> org.apache.solr.search.SolrIndexSearcher > >> =AD Opening Searcher@64148dd8 main > >> 731146 [searcherExecutor-6-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> QuerySenderListener sending requests to Searcher@64148dd8 > >> main{StandardDirectoryReader(segments_15:9:nrt)} > >> 731147 [searcherExecutor-6-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> QuerySenderListener done. > >> 731148 [searcherExecutor-6-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> [quosa2-collection_shard1_replica1] Registered new searcher > >> Searcher@64148dd8 main{StandardDirectoryReader(segments_15:9:nrt)} > >> 731149 [http-bio-8080-exec-9] INFO > org.apache.solr.update.UpdateHandler =AD > >> end_commit_flush > >> 731149 [http-bio-8080-exec-9] INFO > >> org.apache.solr.update.SolrCmdDistributor =AD Distrib commit to:[StdN= ode: > >> http://10.234.215.24:8080/solr/quosa2-collection_shard1_replica3/, > >> StdNode: > >> http://10.229.125.163:8080/solr/quosa2-collection_shard2_replica1/, > >> StdNode: > >> http://10.234.215.24:8080/solr/quosa2-collection_shard2_replica3/, > >> StdNode: > >> http://10.229.125.163:8080/solr/quosa2-collection_shard3_replica1/, > >> StdNode: > >> http://10.234.215.24:8080/solr/quosa2-collection_shard3_replica3/] > >> > >> > params:commit_end_point=3Dtrue&commit=3Dtrue&softCommit=3Dfalse&waitSearc= her=3Dtrue& > >> expungeDeletes=3Dfalse > >> 731170 [http-bio-8080-exec-1] INFO > org.apache.solr.update.UpdateHandler =AD > >> start > >> > >> > commit{,optimize=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeD= eletes=3Dfa > >> lse,softCommit=3Dfalse,prepareCommit=3Dfalse} > >> 731174 [http-bio-8080-exec-10] INFO > org.apache.solr.update.UpdateHandler > >> =AD > >> start > >> > >> > commit{,optimize=3Dfalse,openSearcher=3Dtrue,waitSearcher=3Dtrue,expungeD= eletes=3Dfa > >> lse,softCommit=3Dfalse,prepareCommit=3Dfalse} > >> 731191 [http-bio-8080-exec-1] INFO org.apache.solr.core.SolrCore =AD > >> SolrDeletionPolicy.onCommit: commits:num=3D2 > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard3_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@782256a2; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_1a,generation=3D46,filenames=3D[se= gments_1a] > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard3_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@782256a2; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_1b,generation=3D47,filenames=3D[se= gments_1b] > >> 731192 [http-bio-8080-exec-1] INFO org.apache.solr.core.SolrCore =AD > newest > >> commit =3D 47[segments_1b] > >> 731192 [http-bio-8080-exec-1] INFO > >> org.apache.solr.search.SolrIndexSearcher > >> =AD Opening Searcher@49bbdad main > >> 731193 [searcherExecutor-5-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> QuerySenderListener sending requests to Searcher@49bbdad > >> main{StandardDirectoryReader(segments_19:1:nrt)} > >> 731200 [searcherExecutor-5-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> QuerySenderListener done. > >> 731202 [http-bio-8080-exec-10] INFO org.apache.solr.core.SolrCore = =AD > >> SolrDeletionPolicy.onCommit: commits:num=3D2 > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard2_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7d5549ce; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_1a,generation=3D46,filenames=3D[se= gments_1a] > >> > >> commit{dir=3DNRTCachingDirectory(org.apache.lucene.store.MMapDirectory= @ > >> /www/so > >> lr/home1/quosa2-collection_shard2_replica1/data/index > >> lockFactory=3Dorg.apache.lucene.store.NativeFSLockFactory@7d5549ce; > >> maxCacheMB=3D48.0 > >> > maxMergeSizeMB=3D4.0),segFN=3Dsegments_1b,generation=3D47,filenames=3D[se= gments_1b] > >> 731202 [http-bio-8080-exec-10] INFO org.apache.solr.core.SolrCore = =AD > >> newest > >> commit =3D 47[segments_1b] > >> 731203 [http-bio-8080-exec-10] INFO > >> org.apache.solr.search.SolrIndexSearcher =AD Opening Searcher@5ddf50f= emain > >> 731193 [http-bio-8080-exec-1] INFO > org.apache.solr.update.UpdateHandler =AD > >> end_commit_flush > >> 731205 [searcherExecutor-7-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> QuerySenderListener sending requests to Searcher@5ddf50fe > >> main{StandardDirectoryReader(segments_19:1:nrt)} > >> 731205 [searcherExecutor-7-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> QuerySenderListener done. > >> 731207 [searcherExecutor-7-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> [quosa2-collection_shard2_replica1] Registered new searcher > >> Searcher@5ddf50fe main{StandardDirectoryReader(segments_19:1:nrt)} > >> 731204 [searcherExecutor-5-thread-1] INFO > org.apache.solr.core.SolrCore =AD > >> [quosa2-collection_shard3_replica1] Registered new searcher > >> Searcher@49bbdad > >> main{StandardDirectoryReader(segments_19:1:nrt)} > >> 731207 [http-bio-8080-exec-10] INFO > org.apache.solr.update.UpdateHandler > >> =AD > >> end_commit_flush > >> 731208 [http-bio-8080-exec-10] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard2_replica1] webapp=3D/solr path=3D/update > >> > >> > params=3D{waitSearcher=3Dtrue&commit=3Dtrue&wt=3Djavabin&expungeDeletes= =3Dfalse&commit > >> _end_point=3Dtrue&version=3D2&softCommit=3Dfalse} {commit=3D} 0 35 > >> 731210 [http-bio-8080-exec-1] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard3_replica1] webapp=3D/solr path=3D/update > >> > >> > params=3D{waitSearcher=3Dtrue&commit=3Dtrue&wt=3Djavabin&expungeDeletes= =3Dfalse&commit > >> _end_point=3Dtrue&version=3D2&softCommit=3Dfalse} {commit=3D} 0 41 > >> 731216 [http-bio-8080-exec-9] INFO > >> org.apache.solr.update.processor.LogUpdateProcessor =AD > >> [quosa2-collection_shard1_replica1] webapp=3D/solr path=3D/update/extr= act > >> params=3D{commit=3Dtrue&literal.id=3Dpdf1} {commit=3D} 0 106 > >> > >> > >> Does anyone have any idea how to resolve this? > >> > >> Thanks in advance > >> > >> Mark > >> > >> > >> > >> > >> > >> -- > >> The Wellcome Trust Sanger Institute is operated by Genome Research > >> Limited, a charity registered in England with number 1021457 and a > >> company registered in England with number 2742969, whose registered > >> office is 215 Euston Road, London, NW1 2BE. > >> > >> > > > > -- > The Wellcome Trust Sanger Institute is operated by Genome Research > Limited, a charity registered in England with number 1021457 and a > company registered in England with number 2742969, whose registered > office is 215 Euston Road, London, NW1 2BE. > --e89a8ffba20d08040404dece0a87--