Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0A488DEA2 for ; Wed, 22 May 2013 09:19:52 +0000 (UTC) Received: (qmail 17956 invoked by uid 500); 22 May 2013 09:19:49 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 17470 invoked by uid 500); 22 May 2013 09:19:48 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 17438 invoked by uid 99); 22 May 2013 09:19:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 May 2013 09:19:46 +0000 X-ASF-Spam-Status: No, hits=-5.0 required=5.0 tests=RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of elrand@checkpoint.com designates 194.29.34.68 as permitted sender) Received: from [194.29.34.68] (HELO smtp.checkpoint.com) (194.29.34.68) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 May 2013 09:19:39 +0000 Received: from DAG-EX10.ad.checkpoint.com ([194.29.34.150]) by smtp.checkpoint.com (8.13.8/8.13.8) with ESMTP id r4M9JH5d009854 for ; Wed, 22 May 2013 12:19:17 +0300 X-CheckPoint: {519C8B4A-17-1B221DC2-1FFFF} Received: from IL-EX10.ad.checkpoint.com ([169.254.2.54]) by DAG-EX10.ad.checkpoint.com ([169.254.3.48]) with mapi id 14.02.0342.003; Wed, 22 May 2013 12:19:18 +0300 From: Elran Dvir To: "solr-user@lucene.apache.org" Subject: RE: Upgrade Solr index from 4.0 to 4.2.1 Thread-Topic: Upgrade Solr index from 4.0 to 4.2.1 Thread-Index: Ac5WCErrDww4ZDNsRQeK46j4JmK4xv//8DQA//+Mm7D//fVfYA== Date: Wed, 22 May 2013 09:19:16 +0000 Message-ID: <20043FF20C2364408F5C54E1972A623F072F3ACA@IL-EX10.ad.checkpoint.com> References: <20043FF20C2364408F5C54E1972A623F072F33D5@IL-EX10.ad.checkpoint.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [91.90.128.130] x-kse-antivirus-interceptor-info: scan successful x-kse-antivirus-info: Clean x-cpdlp: 11b63e2b9c8840d7cbe1d7c523f583cba5a31fdb49 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org My index is originally of version 4.0. My methods failed with this configur= ation.=20 So, I changed solrconfig.xml in my index to both versions: LUCENE_42 and = LUCENE_41. For each version in each method (loading and IndexUpgrader), I see the same= errors as before. Thanks. -----Original Message----- From: Elran Dvir=20 Sent: Tuesday, May 21, 2013 6:48 PM To: solr-user@lucene.apache.org Subject: RE: Upgrade Solr index from 4.0 to 4.2.1 Why LUCENE_42?Why not LUCENE_41? Do I still need to run IndexUpgrader or just loading will be enough? Thanks. -----Original Message----- From: Erick Erickson [mailto:erickerickson@gmail.com] Sent: Tuesday, May 21, 2013 2:52 PM To: solr-user@lucene.apache.org Subject: Re: Upgrade Solr index from 4.0 to 4.2.1 This is always something that gives me a headache, but what happens if you = change in solrconfig.xml to LUCENE_40? I'm assuming it= 's LUCENE_42... Best Erick On Tue, May 21, 2013 at 5:48 AM, Elran Dvir wrote: > Hi all, > > I have a 4.0 Solr (sharded/cored) index. > I upgraded Solr to 4.2.1 and tried to load the existing index with it. I = got the following exception: > > May 21, 2013 12:03:42 PM org.apache.solr.common.SolrException log > SEVERE: null:org.apache.solr.common.SolrException: Unable to create core:= other_2013-05-04 > at org.apache.solr.core.CoreContainer.recordAndThrow(Core= Container.java:1672) > at org.apache.solr.core.CoreContainer.create(CoreContaine= r.java:1057) > at org.apache.solr.core.CoreContainer$3.call(CoreContaine= r.java:634) > at org.apache.solr.core.CoreContainer$3.call(CoreContaine= r.java:629) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTa= sk.java:345) > at java.util.concurrent.FutureTask.run(FutureTask.java:17= 7) > at java.util.concurrent.Executors$RunnableAdapter.call(Ex= ecutors.java:482) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTa= sk.java:345) > at java.util.concurrent.FutureTask.run(FutureTask.java:17= 7) > at java.util.concurrent.ThreadPoolExecutor.runWorker(Thre= adPoolExecutor.java:1121) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thr= eadPoolExecutor.java:614) > at java.lang.Thread.run(Thread.java:779) > Caused by: org.apache.solr.common.SolrException: Error opening new search= er > at org.apache.solr.core.SolrCore.(SolrCore.java:822= ) > at org.apache.solr.core.SolrCore.(SolrCore.java:618= ) > at org.apache.solr.core.CoreContainer.createFromLocal(Cor= eContainer.java:1021) > at org.apache.solr.core.CoreContainer.create(CoreContaine= r.java:1051) > ... 10 more > Caused by: org.apache.solr.common.SolrException: Error opening new search= er > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore= .java:1435) > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.jav= a:1547) > at org.apache.solr.core.SolrCore.(SolrCore.java:797= ) > ... 13 more > Caused by: org.apache.solr.common.SolrException: Error opening Reader > at org.apache.solr.search.SolrIndexSearcher.getReader(Sol= rIndexSearcher.java:172) > at org.apache.solr.search.SolrIndexSearcher.(SolrIn= dexSearcher.java:183) > at org.apache.solr.search.SolrIndexSearcher.(SolrIn= dexSearcher.java:179) > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore= .java:1411) > ... 15 more > Caused by: org.apache.lucene.index.CorruptIndexException: codec mismatch:= actual codec=3DLucene40StoredFieldsIndex vs expected codec=3DLucene41Store= dFieldsIndex (resource: MMapIndexInput(path=3D"/var/solr/multicore_solr/oth= er_2013-05-04/data/index/_3gfk.fdx")) > at org.apache.lucene.codecs.CodecUtil.checkHeaderNoMagic(= CodecUtil.java:140) > at org.apache.lucene.codecs.CodecUtil.checkHeader(CodecUt= il.java:130) > at org.apache.lucene.codecs.compressing.CompressingStored= FieldsReader.(CompressingStoredFieldsReader.java:102) > at org.apache.lucene.codecs.compressing.CompressingStored= FieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113) > at org.apache.lucene.index.SegmentCoreReaders.(Segm= entCoreReaders.java:147) > at org.apache.lucene.index.SegmentReader.(SegmentRe= ader.java:56) > at org.apache.lucene.index.StandardDirectoryReader$1.doBo= dy(StandardDirectoryReader.java:62) > at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.= run(SegmentInfos.java:783) > at org.apache.lucene.index.StandardDirectoryReader.open(S= tandardDirectoryReader.java:52) > at org.apache.lucene.index.DirectoryReader.open(Directory= Reader.java:88) > at org.apache.solr.core.StandardIndexReaderFactory.newRea= der(StandardIndexReaderFactory.java:34) > at org.apache.solr.search.SolrIndexSearcher.getReader(Sol= rIndexSearcher.java:169) > ... 18 more > > It seems the problem is with my stored fields. This is the configuration = of all sored fields: > required=3D"true" multiValued=3D"false" /> type=3D"string" indexed=3D"false" stored=3D"true"/> Field "id" is my uniq= ue key. > > So, I looked for a way to upgrade the version of the index. > > I tried Lucene's IndexUpgrader as described here:=20 > http://lucene.apache.org/core/4_2_1/core/org/apache/lucene/index/Index > Upgrader.html I issued this command: java -cp lucene-core-4.2.1.jar=20 > org.apache.lucene.index.IndexUpgrader -verbose=20 > ./other_2013-05-04/data/index I got similar exception: > > Exception in thread "main" java.io.IOException: background merge hit exce= ption: _3ea8(5.0):C170283/17098 _3g2k(5.0):C18785/1858 _3gfe(5.0):C1858/10 = _3gfj(5.0):C3 _3gfg(5.0):C3 _3gfi(5.0):C2 _3gfh(5.0):C1 _3gff(5.0):C1 _3gfk= (5.0):C1 into _3gfm [maxNumSegments=3D1] > at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.jav= a:1674) > at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.jav= a:1610) > at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.ja= va:161) > at > org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:109) > Caused by: org.apache.lucene.index.CorruptIndexException: codec mismatch:= actual codec=3DLucene40StoredFieldsIndex vs expected codec=3DLucene41Store= dFieldsIndex (resource: MMapIndexInput(path=3D"/var/solr/multicore_solr/oth= er_2013-05-04/data/index/_3ea8.fdx")) > at org.apache.lucene.codecs.CodecUtil.checkHeaderNoMagic(CodecUti= l.java:140) > at org.apache.lucene.codecs.CodecUtil.checkHeader(CodecUtil.java:= 130) > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsRe= ader.(CompressingStoredFieldsReader.java:102) > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFo= rmat.fieldsReader(CompressingStoredFieldsFormat.java:113) > at org.apache.lucene.index.SegmentCoreReaders.(SegmentCoreR= eaders.java:147) > at org.apache.lucene.index.SegmentReader.(SegmentReader.jav= a:56) > at org.apache.lucene.index.ReadersAndLiveDocs.getMergeReader(Read= ersAndLiveDocs.java:153) > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.ja= va:3630) > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:329= 6) > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(Concu= rrentMergeScheduler.java:401) > at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Concu > rrentMergeScheduler.java:478) > > Am I doing something wrong? Am I missing something? > Is there a way to configure the stored fields to use Lucene40 index in So= lr 4.2.1 as well? If so, upgrade may be unnecessary. > > Thanks. > Email secured by Check Point