Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 10FDA9555 for ; Sun, 2 Oct 2011 02:00:23 +0000 (UTC) Received: (qmail 48346 invoked by uid 500); 2 Oct 2011 02:00:19 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 48309 invoked by uid 500); 2 Oct 2011 02:00:19 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 48299 invoked by uid 99); 2 Oct 2011 02:00:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Oct 2011 02:00:19 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of goksron@gmail.com designates 209.85.216.176 as permitted sender) Received: from [209.85.216.176] (HELO mail-qy0-f176.google.com) (209.85.216.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Oct 2011 02:00:14 +0000 Received: by qyk27 with SMTP id 27so3130505qyk.14 for ; Sat, 01 Oct 2011 18:59:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=93sN61/irWFJtrlD5iCd7b2EN/Rgjh1tC0GqVC3LQ0M=; b=OMb7JaUJI0JPBd+VmelJN5k4KIUsnHQJScwpQWFhr/0pY9aKixDuantWmg3AG/l3rD BCPzvjLclXYdM78ldwnWLSmeKWmaP9mRrc3xvFIF21Sqrt/RZtiRjbA45RChsrU6up1Y Q41hm00ffL423YVjq6LUU4Hh6KJD4vruQA4SY= MIME-Version: 1.0 Received: by 10.229.88.72 with SMTP id z8mr9865002qcl.297.1317520792964; Sat, 01 Oct 2011 18:59:52 -0700 (PDT) Received: by 10.229.226.149 with HTTP; Sat, 1 Oct 2011 18:59:52 -0700 (PDT) In-Reply-To: References: Date: Sat, 1 Oct 2011 18:59:52 -0700 Message-ID: Subject: Re: Bug in DIH? From: Lance Norskog To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=0016364eead4d94ecd04ae4736ce --0016364eead4d94ecd04ae4736ce Content-Type: text/plain; charset=UTF-8 Should bugs in LogProcessor should be ignored by DIH? They are not required to index data, right? Please open an issue for this. The fix should have two parts: 1) fix the exception 2) log and ignore exceptions in the LogProcessor On Sat, Oct 1, 2011 at 2:02 PM, Pulkit Singhal wrote: > Its rather strange stacktrace(at the bottom). > An entire 10000+ dataset finishes up only to end up crashing & burning > due to a log statement :) > > Based on what I can tell from the stacktrace and the 4.x trunk source > code, it seems that the follwoign log statement dies: > //LogUpdateProcessorFactory.java:188 > log.info( ""+toLog + " 0 " + (elapsed) ); > > Eventually at the strict cast: > //NamedList.java:127 > return (String)nvPairs.get(idx << 1); > > I was wondering what kind of mistaken data would I have ended up > getting misplaced into: > //LogUpdateProcessorFactory.java:76 > private final NamedList