Return-Path: X-Original-To: apmail-manifoldcf-dev-archive@www.apache.org Delivered-To: apmail-manifoldcf-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 941C2F911 for ; Thu, 13 Nov 2014 09:25:47 +0000 (UTC) Received: (qmail 73379 invoked by uid 500); 13 Nov 2014 09:25:47 -0000 Delivered-To: apmail-manifoldcf-dev-archive@manifoldcf.apache.org Received: (qmail 73327 invoked by uid 500); 13 Nov 2014 09:25:47 -0000 Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@manifoldcf.apache.org Delivered-To: mailing list dev@manifoldcf.apache.org Received: (qmail 73316 invoked by uid 99); 13 Nov 2014 09:25:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Nov 2014 09:25:47 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.220.175] (HELO mail-vc0-f175.google.com) (209.85.220.175) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Nov 2014 09:25:19 +0000 Received: by mail-vc0-f175.google.com with SMTP id hy4so6459916vcb.20 for ; Thu, 13 Nov 2014 01:23:45 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=hRdDznZ6cPWhOxOXwZNEQW65lcDGR+d3ssQmFqSWTc4=; b=E5xbgTAogWg8ltnz73tfw5n41aA66loo0Vl4pIddmeF2AAe1yETAgDdL46gSzL5Ubf ULOQRNgx3lnp52Tt6FQhW2EYRHvwDg3O8E4HacMNL4oIuZ2ZdnuOnzGvTn0LSUZ2Br68 ZU3r7Qafu7AlUAHOM1ltfoaV4REBv9O7TxDTHOLgWuxKCV/IOM16fMJcMkLIMG/Hgs96 NpcnygMX7xAahbbH+nHh/uvk27VstP6w7kbvvtGfR3P4EDnbAS5SY2Egx/ELAYnxmOJ8 cZN+AtKG30zDjFsPv6+h3S0twHAEWRIU+aZ03ViFlCsfwj11WVGU0qNbCoSt+tbZaWRi UJ4A== X-Gm-Message-State: ALoCoQkDfOOp3xkj+QR79dcNo6ywjrgmD8kQ3z6tVKsSO7VFcAl7589/XtCykVBI44hcwDFzZyTs MIME-Version: 1.0 X-Received: by 10.52.103.41 with SMTP id ft9mr705542vdb.31.1415870624878; Thu, 13 Nov 2014 01:23:44 -0800 (PST) Received: by 10.221.7.193 with HTTP; Thu, 13 Nov 2014 01:23:44 -0800 (PST) X-Originating-IP: [217.37.166.142] In-Reply-To: References: Date: Thu, 13 Nov 2014 09:23:44 +0000 Message-ID: Subject: Re: Scaling in MCF From: Aeham Abushwashi To: dev@manifoldcf.apache.org Content-Type: multipart/alternative; boundary=047d7b41cc76a4e5ae0507ba11c3 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b41cc76a4e5ae0507ba11c3 Content-Type: text/plain; charset=UTF-8 Thanks Karl, I'll pick that up in the next couple of days and report back on progress. First, I'll start with an empty database and use the null output connector to build up capacity (to >10M docs) in postgresql and test the performance of initial load. Next I'll test performance against a heavily loaded system. Cheers, Aeham --047d7b41cc76a4e5ae0507ba11c3--