Return-Path: X-Original-To: apmail-lucene-solr-user-archive@minotaur.apache.org Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7EB699BB0 for ; Fri, 9 Mar 2012 18:25:24 +0000 (UTC) Received: (qmail 34370 invoked by uid 500); 9 Mar 2012 18:25:21 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 34300 invoked by uid 500); 9 Mar 2012 18:25:21 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 34289 invoked by uid 99); 9 Mar 2012 18:25:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Mar 2012 18:25:21 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of alireza.salimi@gmail.com designates 209.85.212.48 as permitted sender) Received: from [209.85.212.48] (HELO mail-vw0-f48.google.com) (209.85.212.48) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Mar 2012 18:25:13 +0000 Received: by vbjk17 with SMTP id k17so2296915vbj.35 for ; Fri, 09 Mar 2012 10:24:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=cex9zW+pc4R/JzIl+T9AH3BxzCsD/gagEL9ad/6BKTI=; b=Crbmgpc8wsE1Y3Yi5KB8gmwiKXCqhGQlGoL8SeN+pSRPFXKbatJoTS6T61LQt8V1PA NngSgdVha5UgKj4DIRLDuPPQSe5PQdOhI61vIniM2cjGtFpQfznSQEIInZ7Cmu/3iwTC 95i3PF4DYWl+XgyMv4jp+6wrUlpVLUKR7OQKl9xZ78y18yRwCtcxs32kW42oluNpn4sx omi7iyE+AxwgYnq/33x92dEQGfoFPB9ZJ9Ox48wEqFM1JiPR+Gd/luWhkGUHwcbRkXfZ 4OJTqbvWMrW+2OOGWA06t74a+ggO9DhAJAnsByYmx4gADDlcXtofikeM/u+SwsHJ2tNx ZGRQ== Received: by 10.52.155.173 with SMTP id vx13mr3520926vdb.88.1331317492241; Fri, 09 Mar 2012 10:24:52 -0800 (PST) MIME-Version: 1.0 Received: by 10.52.183.164 with HTTP; Fri, 9 Mar 2012 10:24:32 -0800 (PST) From: Alireza Salimi Date: Fri, 9 Mar 2012 13:24:32 -0500 Message-ID: Subject: Lucene vs Solr design decision To: solr-user@lucene.apache.org Content-Type: multipart/alternative; boundary=bcaec5395efc35531004bad38275 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec5395efc35531004bad38275 Content-Type: text/plain; charset=ISO-8859-1 Hi everybody, Let's say we have a system with billions of small documents (average of 2-3 fields). and each document belongs to JUST ONE user and searches are user specific, meaning that when we search for something, we just look into documents of that user. On the other hand we need to see the newly added documents as soon as they are added to the indexes. Now I think we have two solutions: 1. Use Lucene directly and create a separate index file for each user 2. Use Solr and store all of the users' data all together in one HUGE index file the benefit of using Lucene is that each commit() will take less time comparing to the case that we use Solr. Is there any suggested solution for cases like this? Thanks -- Alireza Salimi Java EE Developer --bcaec5395efc35531004bad38275--