Return-Path: Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: (qmail 27537 invoked from network); 12 Apr 2011 13:08:12 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 12 Apr 2011 13:08:12 -0000 Received: (qmail 71738 invoked by uid 500); 12 Apr 2011 13:08:10 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 71596 invoked by uid 500); 12 Apr 2011 13:08:10 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 71588 invoked by uid 99); 12 Apr 2011 13:08:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Apr 2011 13:08:09 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of erickerickson@gmail.com designates 209.85.216.169 as permitted sender) Received: from [209.85.216.169] (HELO mail-qy0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Apr 2011 13:08:03 +0000 Received: by qyk2 with SMTP id 2so2228297qyk.14 for ; Tue, 12 Apr 2011 06:07:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=RpHY4fA6N8gY8QHw6zugRf5nqAvf3vV5r3JucpoMcIY=; b=lyX+UPl3FFaHC17tjnZzNQzDDgG1dmkPkr+GBPijJ1HQ2+roQNPNhvrPpHBZkMQYIO HZx4ozbXSYIBUnsDcFhUVPuZdSoHAoNZ7I7d1WbB9ooTs9QdoYM1AJy90QvpL+cLAL7U Evz6ALV0hMqFU9H5M9O/hI2tHlBMRWFwxVByY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=EWwaVFSemTU4v1nSlzIOx3nCI4zveYadJec0ISBva7BiAufuCOHcfADBgU7gBLY/kA k9qT4A1gUA8tbT0wMa8+Wbny7IGkQ72XsmvJdxikuXPO4WB7teOn0/KfhLnxAlydN0Rb BDMZscZueBvzdNXQu3XcHqLv48nqFkcGq9yp0= MIME-Version: 1.0 Received: by 10.229.111.194 with SMTP id t2mr5151918qcp.122.1302613662524; Tue, 12 Apr 2011 06:07:42 -0700 (PDT) Received: by 10.229.120.81 with HTTP; Tue, 12 Apr 2011 06:07:42 -0700 (PDT) In-Reply-To: References: Date: Tue, 12 Apr 2011 09:07:42 -0400 Message-ID: Subject: Re: SolrException: Unavailable Service From: Erick Erickson To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=0022153de27ba265fd04a0b860ee X-Virus-Checked: Checked by ClamAV on apache.org --0022153de27ba265fd04a0b860ee Content-Type: text/plain; charset=ISO-8859-1 If your commit from the client fails, you don't really know the state of your index anyway. All the threads you have sending documents to Solr are adding them to a single internal buffer. Committing flushes that buffer. So if thread 1 gets an error on commit, it will presumably have some documents from thread 2 in the commit. But thread 2 won't necessarily see the results. So I don't think your statement about needing to know if a commit fails is really On Tue, Apr 12, 2011 at 8:50 AM, Phong Dais wrote: > Hi, > > I did not want to hijack this thread ( > http://www.mail-archive.com/solr-user@lucene.apache.org/msg34181.html) > but I am experiencing the same exact problem mentioned here. > > To sum up the issue, I am getting intermittent "Unavailable Service" > exception during indexing commit phase. > I know that I am calling commit "very often" but I do not see any way > around > this. This is my situation, I am > indexing a huge amount of documents using multiple instance of SolrJ client > running on multiple servers. There is no way > for me control when "commit" is called from these clients, so two different > clients can call commit "at the same time". > I am not sure if I can/should use auto/timed commit because I need to know > if a commit failed so I can rollback the batch that failed. > > What kind of options do I have? > Should I try to catch the exception and keep trying to "recommit" until it > goes through? I can see some potential of problems with this approach. > Do I need to write a request broker to queue up all these commit and send > them to solr one by one in a "timely" manner? > > Just wanted to know if anyone has a solution for this problem before I dive > off the deep end. > > Thanks, > Phong > --0022153de27ba265fd04a0b860ee--