From user-return-5201-archive-asf-public=cust-asf.ponee.io@manifoldcf.apache.org Wed Jun 13 15:23:20 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id AB2B1180609 for ; Wed, 13 Jun 2018 15:23:19 +0200 (CEST) Received: (qmail 71615 invoked by uid 500); 13 Jun 2018 13:23:18 -0000 Mailing-List: contact user-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@manifoldcf.apache.org Delivered-To: mailing list user@manifoldcf.apache.org Received: (qmail 71605 invoked by uid 99); 13 Jun 2018 13:23:18 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Jun 2018 13:23:18 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 323D7180873 for ; Wed, 13 Jun 2018 13:23:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.999 X-Spam-Level: * X-Spam-Status: No, score=1.999 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Plmx800B4pxe for ; Wed, 13 Jun 2018 13:23:15 +0000 (UTC) Received: from 3.mo69.mail-out.ovh.net (3.mo69.mail-out.ovh.net [188.165.52.203]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 21FBF5F343 for ; Wed, 13 Jun 2018 13:23:15 +0000 (UTC) Received: from player158.ha.ovh.net (unknown [10.109.108.76]) by mo69.mail-out.ovh.net (Postfix) with ESMTP id 6D80315E9C for ; Wed, 13 Jun 2018 15:23:09 +0200 (CEST) Received: from macoliv.home (LFbn-NIC-1-188-134.w2-15.abo.wanadoo.fr [2.15.37.134]) (Authenticated sender: olivier.tavard@francelabs.com) by player158.ha.ovh.net (Postfix) with ESMTPSA id 354A76200B6 for ; Wed, 13 Jun 2018 15:23:09 +0200 (CEST) From: Olivier Tavard Content-Type: multipart/alternative; boundary="Apple-Mail=_D466D8AF-00DF-49CA-A232-CC38FEB9D976" Mime-Version: 1.0 (Mac OS X Mail 11.4 \(3445.8.2\)) Subject: Sharepoint 2013 indexation time performance Message-Id: <0C1BE1F1-1582-492E-B16F-3968C1612954@francelabs.com> Date: Wed, 13 Jun 2018 15:23:08 +0200 To: user@manifoldcf.apache.org X-Mailer: Apple Mail (2.3445.8.2) X-Ovh-Tracer-Id: 1926696218452584696 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedthedrledtgdeihecutefuodetggdotefrodftvfcurfhrohhfihhlvgemucfqggfjpdevjffgvefmvefgnecuuegrihhlohhuthemuceftddtnecu --Apple-Mail=_D466D8AF-00DF-49CA-A232-CC38FEB9D976 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, I have a question regarding the performance of the Sharepoint repository = connector. Recently we did some tests using MCF 2.8.1 to crawl some documents on a = Sharepoint 2013 server. There were few documents : only 700 all located = on the same documents list. For full indexation the indexation speed was about 60 docs/min (with = security activated : SP native authority connector). For incremental indexation with one file modified and one file added, = the indexation speed was 80 docs/min. I know that of course, the performance depends of many factors but if = someone already indexed large Sharepoint servers and could post the = performances obtained, it would be be great to compare. Tests done on two VMs on a ESXI server CPU : Xeon D-1520 RAM : 64GB - VM for Sharepoint 2013 : all Sharepoint services installed on the same VM=20 4 VCPU, 16 GB RAM - VM for MCF=20 4 VCPU, 24 GB RAM MCF 2.8.1, multiprocess with Zookeeper Thanks, Best regards, Olivier TAVARD --Apple-Mail=_D466D8AF-00DF-49CA-A232-CC38FEB9D976 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Hi,

I = have a question regarding the performance of the Sharepoint repository = connector.
Recently we did some tests using MCF = 2.8.1 to crawl some documents on a Sharepoint 2013 server. There were = few documents : only 700 all located on the same documents = list.
For full indexation the indexation speed was = about 60 docs/min (with security activated : SP native authority = connector).
For incremental indexation with one = file modified and one file added, the indexation speed was 80 = docs/min.

I = know that of course, the performance depends of many factors but if = someone already indexed large Sharepoint servers and could post the = performances obtained, it would be be great to compare.

Tests done on two VMs on = a ESXI server CPU : Xeon D-1520  RAM : 64GB
- = VM for Sharepoint 2013 :
all Sharepoint services = installed on the same VM 
4 VCPU, 16 GB = RAM

- VM for = MCF 
4 VCPU, 24 GB RAM
MCF = 2.8.1, multiprocess with Zookeeper

Thanks,

Best regards,

Olivier TAVARD

= --Apple-Mail=_D466D8AF-00DF-49CA-A232-CC38FEB9D976--