Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5E5F5200C63 for ; Thu, 27 Apr 2017 07:40:29 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5CE93160BB4; Thu, 27 Apr 2017 05:40:29 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A565D160BA8 for ; Thu, 27 Apr 2017 07:40:28 +0200 (CEST) Received: (qmail 48376 invoked by uid 500); 27 Apr 2017 05:40:27 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 48364 invoked by uid 99); 27 Apr 2017 05:40:26 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Apr 2017 05:40:26 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 51BC5C0DB2 for ; Thu, 27 Apr 2017 05:40:26 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.281 X-Spam-Level: * X-Spam-Status: No, score=1.281 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=messagingengine.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id IAaqa0oM98cR for ; Thu, 27 Apr 2017 05:40:24 +0000 (UTC) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 8D00E5F297 for ; Thu, 27 Apr 2017 05:40:23 +0000 (UTC) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id DBBC6209F6 for ; Thu, 27 Apr 2017 01:40:22 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute1.internal (MEProxy); Thu, 27 Apr 2017 01:40:22 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc:x-sasl-enc; s=fm1; bh=49kgAFXKCZyiMf46// ImNfr8IlAvZ1GKloXdRw2dF/o=; b=n6WiyZbbDirp/8z2Y1Qi9VxIMQ2mTcbWjC 43Co5rDZzQH8JDFMZ4gQCiYHhAIKocu4RMYKko+yq3xPRCtaE7WZQ8bQ6ZTY3cwU SW2we08PF++PIZUoBjEeCSWFoyTiZafSML2hmo/pyoipWgYZDDK7VLqZzktohncY abv4YaRwvHAjcR/1aoDoJ37Hy0cCm+68SUVRiZj0AvX+zWBx+WxuXwCrIYTlTmJz lRlxUo6a0eS8SqVezA2JoBUMHhaFBmG88p1slHVdmbV9xMtzALhjDIKA33OgF8A0 IIntttQ7hQQfX8gAK9F17uTCFwaKe6coQR8SMw9hIkGkrwhjJ8IQ== X-ME-Sender: X-Sasl-enc: 5GPgs+sz+lEfU0ZFKhMcwp/0nTicxaDGw335zKhp1FvI 1493271622 Received: from [192.168.1.69] (76-218-104-65.lightspeed.sntcca.sbcglobal.net [76.218.104.65]) by mail.messagingengine.com (Postfix) with ESMTPA id 6D0EE247DC for ; Thu, 27 Apr 2017 01:40:22 -0400 (EDT) From: Walter Underwood Content-Type: multipart/alternative; boundary="Apple-Mail=_5F2CA820-8DF4-440A-9166-3F43A1A3CFBE" Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: 1 main collection or multiple smaller collections? Date: Wed, 26 Apr 2017 22:40:21 -0700 References: <590180BD.7000804@globalsources.com> <9341E9F4-E7CF-475C-92F2-C1FFEED939EA@wunderwood.org> To: solr-user@lucene.apache.org In-Reply-To: <9341E9F4-E7CF-475C-92F2-C1FFEED939EA@wunderwood.org> Message-Id: X-Mailer: Apple Mail (2.3273) archived-at: Thu, 27 Apr 2017 05:40:29 -0000 --Apple-Mail=_5F2CA820-8DF4-440A-9166-3F43A1A3CFBE Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Also, 300,000 documents is fairly small for Solr. We handle a million = queries per day with a few servers on a collection that size. wunder Walter Underwood wunder@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Apr 26, 2017, at 10:33 PM, Walter Underwood = wrote: >=20 > Do they have the same fields or different fields? Are they updated = separately or together? >=20 > If they have the same fields and are updated together, I=E2=80=99d put = them in the same collection. Otherwise, probably separate. >=20 > wunder > Walter Underwood > wunder@wunderwood.org > http://observer.wunderwood.org/ (my blog) >=20 >=20 >> On Apr 26, 2017, at 10:25 PM, Derek Poh = wrote: >>=20 >> Hi >> I amplanning for a migration of a legacy searchengine to Solr. >> Basically thedata can be categorisedinto suppliersinfo, suppliers = products info and products category info. These sets of data are related = to each other. >> suppliers products data, which is the largest, have around 300,000 = records currentlyand projected to increase. >>=20 >> Should I put these data in 1 single collection or in separate = collections - eg. 1 collection for suppliers info, 1 collection for = suppliers products infoand 1 collection fo products categories info? >> What should I consider and plan for when deciding which option to = take? >>=20 >> Derek >>=20 >> ---------------------- >> CONFIDENTIALITY NOTICE=20 >> This e-mail (including any attachments) may contain confidential = and/or privileged information. If you are not the intended recipient or = have received this e-mail in error, please inform the sender immediately = and delete this e-mail (including any attachments) from your computer, = and you must not use, disclose to anyone else or copy this e-mail = (including any attachments), whether in whole or in part.=20 >> This e-mail and any reply to it may be monitored for security, legal, = regulatory compliance and/or other appropriate reasons. >=20 --Apple-Mail=_5F2CA820-8DF4-440A-9166-3F43A1A3CFBE--