Return-Path: Delivered-To: apmail-lucene-solr-user-archive@locus.apache.org Received: (qmail 89951 invoked from network); 5 Jan 2009 10:43:23 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 5 Jan 2009 10:43:23 -0000 Received: (qmail 75634 invoked by uid 500); 5 Jan 2009 10:43:19 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 75598 invoked by uid 500); 5 Jan 2009 10:43:19 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 75587 invoked by uid 99); 5 Jan 2009 10:43:18 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Jan 2009 02:43:18 -0800 X-ASF-Spam-Status: No, hits=2.6 required=10.0 tests=DNS_FROM_OPENWHOIS,SPF_HELO_PASS,SPF_PASS,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates 216.139.236.158 as permitted sender) Received: from [216.139.236.158] (HELO kuber.nabble.com) (216.139.236.158) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Jan 2009 10:43:09 +0000 Received: from isper.nabble.com ([192.168.236.156]) by kuber.nabble.com with esmtp (Exim 4.63) (envelope-from ) id 1LJmv2-0002PC-ER for solr-user@lucene.apache.org; Mon, 05 Jan 2009 02:42:48 -0800 Message-ID: <21288838.post@talk.nabble.com> Date: Mon, 5 Jan 2009 02:42:48 -0800 (PST) From: Marc Sturlese To: solr-user@lucene.apache.org Subject: Re: Deduplication patch not working in nightly build In-Reply-To: <5e76b0ad0901050140q9b3bc10o8b9a51a9368fe8eb@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Nabble-From: marc.sturlese@gmail.com References: <21287327.post@talk.nabble.com> <5e76b0ad0901050140q9b3bc10o8b9a51a9368fe8eb@mail.gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org Yeah looks like but... if I don't use the DeDuplication patch everything works perfect. I can create my indexed using full import and delta import without problems. The JdbcDataSource of the nightly is pretty similar to th= e 1.3 release... The DeDuplication patch doesn't touch the dataimporthandler classes... it's coz I thought the problem was not there (but can't say it for sure...) I was thinking that the problem has something to do with the UpdateRequestProcessorChain but don't know how this part of the source works... Any advice how could I sort it? I am really interested in updating to the nightly build as I think new facet algorithm and SolrDeletionPolicy are really great stuff! Thanks Noble Paul =E0=B4=A8=E0=B5=8B=E0=B4=AC=E0=B4=BF=E0=B4=B3=E0=B5=8D=E2=80=8D = =E0=A4=A8=E0=A5=8B=E0=A4=AC=E0=A5=8D=E0=A4=B3=E0=A5=8D wrote: >=20 > looks like a bug w/ DIH with the recent fixes. > --Noble >=20 > On Mon, Jan 5, 2009 at 2:36 PM, Marc Sturlese > wrote: >> >> Hey there, >> I was using the Deduplication patch with Solr 1.3 release and everything >> was >> working perfectly. Now I upgraded to a nigthly build (20th december) to >> be >> able to use new facet algorithm and other stuff and DeDuplication is not >> working any more. I have followed exactly the same steps to apply the >> patch >> to the source code. I am geting this error: >> >> WARNING: Error reading data >> com.mysql.jdbc.CommunicationsException: Communications link failure due >> to >> underlying exception: >> >> ** BEGIN NESTED EXCEPTION ** >> >> java.io.EOFException >> >> STACKTRACE: >> >> java.io.EOFException >> at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1905) >> at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2404) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2862) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:771) >> at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1289) >> at >> com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDynamic.java:362) >> at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic.java:352) >> at com.mysql.jdbc.ResultSet.next(ResultSet.java:6144) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasn= ext(JdbcDataSource.java:294) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.acce= ss$400(JdbcDataSource.java:189) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.ha= sNext(JdbcDataSource.java:225) >> at >> org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityPro= cessorBase.java:229) >> at >> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityP= rocessor.java:76) >> at >> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.j= ava:351) >> at >> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java= :193) >> at >> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:14= 4) >> at >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporte= r.java:334) >> at >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java= :407) >> at >> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:= 388) >> >> >> ** END NESTED EXCEPTION ** >> Last packet sent to the server was 202481 ms ago. >> at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2563) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2862) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:771) >> at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1289) >> at >> com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDynamic.java:362) >> at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic.java:352) >> at com.mysql.jdbc.ResultSet.next(ResultSet.java:6144) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasn= ext(JdbcDataSource.java:294) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.acce= ss$400(JdbcDataSource.java:189) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.ha= sNext(JdbcDataSource.java:225) >> at >> org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityPro= cessorBase.java:229) >> at >> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityP= rocessor.java:76) >> at >> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.j= ava:351) >> at >> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java= :193) >> at >> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:14= 4) >> at >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporte= r.java:334) >> at >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java= :407) >> at >> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:= 388) >> Jan 5, 2009 10:06:16 AM org.apache.solr.handler.dataimport.JdbcDataSourc= e >> logError >> WARNING: Exception while closing result set >> com.mysql.jdbc.CommunicationsException: Communications link failure due >> to >> underlying exception: >> >> ** BEGIN NESTED EXCEPTION ** >> >> java.io.EOFException >> >> STACKTRACE: >> >> java.io.EOFException >> at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1905) >> at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2351) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2862) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:771) >> at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1289) >> at >> com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDynamic.java:362) >> at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic.java:352) >> at com.mysql.jdbc.RowDataDynamic.close(RowDataDynamic.java:150) >> at com.mysql.jdbc.ResultSet.realClose(ResultSet.java:6488) >> at com.mysql.jdbc.ResultSet.close(ResultSet.java:736) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.clos= e(JdbcDataSource.java:312) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasn= ext(JdbcDataSource.java:304) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.acce= ss$400(JdbcDataSource.java:189) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.ha= sNext(JdbcDataSource.java:225) >> at >> org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityPro= cessorBase.java:229) >> at >> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityP= rocessor.java:76) >> at >> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.j= ava:351) >> at >> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java= :193) >> at >> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:14= 4) >> at >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporte= r.java:334) >> at >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java= :407) >> at >> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:= 388) >> >> >> ** END NESTED EXCEPTION ** >> >> Last packet sent to the server was 202482 ms ago. >> at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2563) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2862) >> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:771) >> at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1289) >> at >> com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDynamic.java:362) >> at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic.java:352) >> at com.mysql.jdbc.RowDataDynamic.close(RowDataDynamic.java:150) >> at com.mysql.jdbc.ResultSet.realClose(ResultSet.java:6488) >> at com.mysql.jdbc.ResultSet.close(ResultSet.java:736) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.clos= e(JdbcDataSource.java:312) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasn= ext(JdbcDataSource.java:304) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.acce= ss$400(JdbcDataSource.java:189) >> at >> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.ha= sNext(JdbcDataSource.java:225) >> at >> org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityPro= cessorBase.java:229) >> at >> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityP= rocessor.java:76) >> at >> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.j= ava:351) >> at >> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java= :193) >> at >> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:14= 4) >> at >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporte= r.java:334) >> at >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java= :407) >> at >> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:= 388) >> >> Mark do you know if I should to some extra hack to run DeDuplication >> patch >> in the new solr version (nightly)? Has something changed in the source >> that >> make it not work or it's simply that i am doing something wrong? >> >> Thanks in advanced >> -- >> View this message in context: >> http://www.nabble.com/Deduplication-patch-not-working-in-nightly-build-t= p21287327p21287327.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> >=20 >=20 >=20 > --=20 > --Noble Paul >=20 >=20 --=20 View this message in context: http://www.nabble.com/Deduplication-patch-not= -working-in-nightly-build-tp21287327p21288838.html Sent from the Solr - User mailing list archive at Nabble.com.