Return-Path: Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: (qmail 55889 invoked from network); 2 Aug 2010 21:59:35 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 2 Aug 2010 21:59:35 -0000 Received: (qmail 93516 invoked by uid 500); 2 Aug 2010 21:59:33 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 93469 invoked by uid 500); 2 Aug 2010 21:59:32 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 93461 invoked by uid 99); 2 Aug 2010 21:59:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Aug 2010 21:59:32 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.69.42.181] (HELO radix.cryptio.net) (208.69.42.181) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Aug 2010 21:59:26 +0000 Received: by radix.cryptio.net (Postfix, from userid 1007) id DC7AB71CEB8; Mon, 2 Aug 2010 14:59:05 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by radix.cryptio.net (Postfix) with ESMTP id DA2E571CA64 for ; Mon, 2 Aug 2010 14:59:05 -0700 (PDT) Date: Mon, 2 Aug 2010 14:59:05 -0700 (PDT) From: Chris Hostetter To: solr-user@lucene.apache.org Subject: Re: Implementing lookups while importing data In-Reply-To: <20100729152139.321c4575@ibis> Message-ID: References: <20100729152139.321c4575@ibis> User-Agent: Alpine 1.10 (DEB 962 2008-03-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII : We have a database that has numeric values for some columns, which : correspond to text values in drop-downs on a website. We need to : index both the numeric and text equivalents into Solr, and can do : that via a lookup on a different table from the one holding the : main data. We are currently doing this via a JOIN on the numeric : field, between the main data table and the lookup table, but this : dramatically slows down indexing. : : We could try using the CachedSqlEntity processor, but there are : some issues in doing that, as the data import handler is quite : complicated. wha you are describing is pretty much the exact use case of the CachedSqlEntity (as i understand it) so perhaps you should elaborate on what issues you had. showing your DIH config is the best way ot get assistance. -Hoss