Return-Path: Delivered-To: apmail-lucene-dev-archive@www.apache.org Received: (qmail 31833 invoked from network); 9 Jun 2010 15:19:41 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 9 Jun 2010 15:19:41 -0000 Received: (qmail 13894 invoked by uid 500); 9 Jun 2010 15:19:40 -0000 Delivered-To: apmail-lucene-dev-archive@lucene.apache.org Received: (qmail 13843 invoked by uid 500); 9 Jun 2010 15:19:40 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 13836 invoked by uid 99); 9 Jun 2010 15:19:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jun 2010 15:19:40 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of markrmiller@gmail.com designates 74.125.83.48 as permitted sender) Received: from [74.125.83.48] (HELO mail-gw0-f48.google.com) (74.125.83.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jun 2010 15:19:33 +0000 Received: by gwb17 with SMTP id 17so5447910gwb.35 for ; Wed, 09 Jun 2010 08:19:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=aaEyJ2c++xQ9Jnk3SbHdFONKmjGXke1tsviS6aOoGdE=; b=QhaEHMGg+OvfFq6OV0Siqj6cQDNNBC5W81bd/DTXH8FOij01azEPKL2AH8Kn5+AO1p ePfN5eu38R4OyTX4AcXQqH0xvSP+JCvWJncyVFDdjtmtvpA9dRVCbKFAzuAS9cbS803n sBbhCkLpnSZmzKkfc3O9D0+26J5AtzhIiwLYU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; b=Xm+EgwC0EBtHdbnwlVzjHkV5EQZxI+SfxSTuqK3JDKC5nFOVktts6NgwQ6hSgWIMuf fM3tuQ5zTkZTpqo56yXjCRFCCfl7N6DuCUzjwYZ3+8gEc5vp9zpf1P3HFeqe0Lv7JD28 f6qu04B0DoOCfFakFBe78lyuKYjbCFvFnVmbs= Received: by 10.150.131.12 with SMTP id e12mr17329408ybd.237.1276096747810; Wed, 09 Jun 2010 08:19:07 -0700 (PDT) Received: from Mark-Millers-MacBook-Pro.local (72-254-86-134.client.stsn.net [72.254.86.134]) by mx.google.com with ESMTPS id u4sm5798614ybh.22.2010.06.09.08.19.05 (version=SSLv3 cipher=RC4-MD5); Wed, 09 Jun 2010 08:19:06 -0700 (PDT) Message-ID: <4C0FB0E7.9070109@gmail.com> Date: Wed, 09 Jun 2010 08:19:03 -0700 From: Mark Miller User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4 MIME-Version: 1.0 To: dev@lucene.apache.org Subject: Re: Solr spewage and dropped documents, while indexing References: <4C0FA77A.7010708@gmail.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hang on though - I saw a commons jira issue from 08 that claimed the javadoc for this class was misleading and there was no default cleaner set - that issue was resolved, but the javadoc *still* seemed to indicate there was a default cleaner in use ... so I wondered if the code had changed, or the javadoc was still misleading ... Looking at getFileCleaningTracker(), it also says: An instance of FileCleaningTracker, defaults to FileCleaner.getInstance(). But then looking at the code, I don't see how that is possible. It really appears to default to null (no cleaner). So I ran a quick test, printing out the cleaning tracker, and it prints 'null'. So, perhaps we try setting one and see where your problem is? It really appears the javadoc I'm seeing does not match the code. - Mark On 6/9/10 8:01 AM, karl.wright@nokia.com wrote: > Ok, that theory bites the dust then... > > I'll have to work on some diagnostics then to see why the content doesn't get added. > > Karl > > -----Original Message----- > From: ext Mark Miller [mailto:markrmiller@gmail.com] > Sent: Wednesday, June 09, 2010 10:39 AM > To: dev@lucene.apache.org > Subject: Re: Solr spewage and dropped documents, while indexing > > On 6/9/10 6:01 AM, karl.wright@nokia.com wrote: >> >> but if I correctly recall how DiskFileItemFactory works, it creates >> files and registers them to be cleaned up on JVM exit. If that's the >> only cleanup, that's not going to cut it for a real-world system. > > Class DiskFileItemFactory > > "Temporary files are automatically deleted as soon as they are no longer > needed. (More precisely, when the corresponding instance of File is > garbage collected.) Cleaning up those files is done by an instance of > FileCleaningTracker, and an associated thread." > -- - Mark http://www.lucidimagination.com --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional commands, e-mail: dev-help@lucene.apache.org