Return-Path: X-Original-To: apmail-lucene-java-user-archive@www.apache.org Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 85F73184ED for ; Tue, 9 Jun 2015 16:23:52 +0000 (UTC) Received: (qmail 85971 invoked by uid 500); 9 Jun 2015 16:23:49 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 85894 invoked by uid 500); 9 Jun 2015 16:23:49 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 85100 invoked by uid 99); 9 Jun 2015 16:23:49 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Jun 2015 16:23:49 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B37B31A4938 for ; Tue, 9 Jun 2015 16:23:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.988 X-Spam-Level: ** X-Spam-Status: No, score=2.988 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id mJP2fbuUGFiv for ; Tue, 9 Jun 2015 16:23:38 +0000 (UTC) Received: from e06smtp15.uk.ibm.com (e06smtp15.uk.ibm.com [195.75.94.111]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 92868249FD for ; Tue, 9 Jun 2015 16:23:37 +0000 (UTC) Received: from /spool/local by e06smtp15.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Tue, 9 Jun 2015 17:23:36 +0100 Received: from d06dlp02.portsmouth.uk.ibm.com (9.149.20.14) by e06smtp15.uk.ibm.com (192.168.101.145) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; Tue, 9 Jun 2015 17:23:34 +0100 Received: from b06cxnps3074.portsmouth.uk.ibm.com (d06relay09.portsmouth.uk.ibm.com [9.149.109.194]) by d06dlp02.portsmouth.uk.ibm.com (Postfix) with ESMTP id 21134219004D; Tue, 9 Jun 2015 17:23:13 +0100 (BST) Received: from d06av01.portsmouth.uk.ibm.com (d06av01.portsmouth.uk.ibm.com [9.149.37.212]) by b06cxnps3074.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id t59GNXYw24641784; Tue, 9 Jun 2015 16:23:33 GMT Received: from d06av01.portsmouth.uk.ibm.com (localhost [127.0.0.1]) by d06av01.portsmouth.uk.ibm.com (8.14.4/8.14.4/NCO v10.0 AVout) with ESMTP id t59GNXNJ021135; Tue, 9 Jun 2015 10:23:33 -0600 Received: from d06ml319.portsmouth.uk.ibm.com (d06ml319.portsmouth.uk.ibm.com [9.149.76.146]) by d06av01.portsmouth.uk.ibm.com (8.14.4/8.14.4/NCO v10.0 AVin) with ESMTP id t59GNXkd021132; Tue, 9 Jun 2015 10:23:33 -0600 To: solr-user@lucene.apache.org, java-user@lucene.apache.org, dev@lucene.apache.org Cc: Gili Nachum , Gianluca Amori , Eitan Shapiro MIME-Version: 1.0 Subject: CheckIndex failed for Solr 4.7.2 index X-KeepSent: D68ABBF8:948990A2-C2257E5F:005775B5; type=4; name=$KeepSent X-Mailer: IBM Notes Release 9.0.1SHF211 December 19, 2013 From: Guy Moshkowich Message-ID: Date: Tue, 9 Jun 2015 19:23:32 +0300 X-MIMETrack: Serialize by Router on D06ML319/06/M/IBM(Release 9.0.1FP3|January 12, 2015) at 09/06/2015 19:23:33, Serialize complete at 09/06/2015 19:23:33 Content-Type: multipart/alternative; boundary="=_alternative 005A1381C2257E5F_=" X-TM-AS-MML: disable X-Content-Scanned: Fidelis XPS MAILER x-cbid: 15060916-0021-0000-0000-000004357204 --=_alternative 005A1381C2257E5F_= Content-Type: text/plain; charset="US-ASCII" We are using Solr 4.7.2 and we found that when we run CheckIndex.checkIndex on one of the Solr shards we are getting the error below. Both replicas of the shard had the same error. The shard index looked healthy: 1) It appeared active in the Solr admin page. 2) We could run searches against it. 3) No relevant errors where found in Solr logs. 4) After we optimized the index in LUKE, CheckIndex did not report any error. My questions: 1) Is this is a real issue or a known bug in CheckIndex code that cause false negative ? 2) Is there a known fix for this issue? Here is the error we got: validateIndex Segments file=segments_bhe numSegments=15 version=4.7 format= userData={commitTimeMSec=1432689607801} 1 of 15: name=_6cth docCount=248744 codec=Lucene46 compound=false numFiles=11 size (MB)=86.542 diagnostics = {timestamp=1428883354605, os=Linux, os.version=2.6.32-431.23.3.el6.x86_64, mergeFactor=10, source=merge, lucene.version=4.7.2 1586229 - rmuir - 2014-04-10 09:00:35, os.arch=amd64, mergeMaxNumSegments=-1, java.version=1.7.0, java.vendor=IBM Corporation} has deletions [delGen=3174] test: open reader.........FAILED WARNING: fixIndex() would remove reference to this segment; full exception: java.lang.RuntimeException: liveDocs count mismatch: info=156867, vs bits=156872 at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:581) at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:372) Appreciate yout help, Guy. --=_alternative 005A1381C2257E5F_=--