Return-Path: X-Original-To: apmail-subversion-users-archive@minotaur.apache.org Delivered-To: apmail-subversion-users-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C7FC49EB5 for ; Sun, 14 Oct 2012 20:09:21 +0000 (UTC) Received: (qmail 18069 invoked by uid 500); 14 Oct 2012 20:09:21 -0000 Delivered-To: apmail-subversion-users-archive@subversion.apache.org Received: (qmail 18050 invoked by uid 500); 14 Oct 2012 20:09:21 -0000 Mailing-List: contact users-help@subversion.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list users@subversion.apache.org Received: (qmail 18043 invoked by uid 99); 14 Oct 2012 20:09:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Oct 2012 20:09:21 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jcorvel@gmail.com designates 209.85.212.43 as permitted sender) Received: from [209.85.212.43] (HELO mail-vb0-f43.google.com) (209.85.212.43) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Oct 2012 20:09:14 +0000 Received: by mail-vb0-f43.google.com with SMTP id fq11so5769214vbb.16 for ; Sun, 14 Oct 2012 13:08:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=EvedmPUwwVTw32Smik/+7lSM8iWBqfjLuEGw98J92Xs=; b=d04/zyqo+AI2fG6yGfJhHEWzBA/5PLDJ7TPd/KMlwS2WH02ALkzWGCa9wZ3wFQDewd u41SO3vnKg0O7hL2DMHkHlTajW1ZOhtSQz1LoF9pu0Chva30ONxISkyI2qMjzCZ1TO3I S3ZuS53vr5S3C14DtSlY+l8jW3TTY02O5jJ9R2eybTVhcsE+jQyUwYgBt9PdEpNt5UMu lOQVVdoXByxYCnUD09yQSV9RHyFi5PEntOTu9UCoClJhsAdSzn4Qg286vpZhxqp4rx0C l2MXYX8NqYmHsxFmT+UnKwVhcMVouLbIZBjg9UE2f5fKwDaO1RHOWTkTFaZBnUsytMgU ymzA== Received: by 10.220.222.212 with SMTP id ih20mr5546336vcb.59.1350245333707; Sun, 14 Oct 2012 13:08:53 -0700 (PDT) MIME-Version: 1.0 Received: by 10.220.212.79 with HTTP; Sun, 14 Oct 2012 13:08:33 -0700 (PDT) In-Reply-To: References: <507831dd.4255420a.30b0.ffffbc49@mx.google.com> From: Johan Corveleyn Date: Sun, 14 Oct 2012 22:08:33 +0200 Message-ID: Subject: Re: Extremely slow checkout on a large repository To: Bai Wei Cc: Andy Levy , users@subversion.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org On Sun, Oct 14, 2012 at 3:06 AM, Bai Wei wrote: > Hi Andy, Thank you for your prompt reply. > > I found the performance problem was caused by 21406 files inside a single > folder, total size of this folder > is 255M. (sorry for this bad layout, but this is not in my control) ... > Client side: > svn version 1.6.11 (r934486) ... > I also tested to checkout this folder on server side machine, with svn > 1.7.7, to tmpfs, > it takes only 16 seconds, this significant improvement must be attribute to > new working copy library (WC-NG) in svn 1.7? > Thank SVN dev team for your continuous efforts in optimization. > > BTW. it's still painfully slow to checkout this repository to hard disk, > if disk IO will be optimized in future version of svn , it will be a good > news. I think if you upgrade your client-side to at least 1.6.17, you'll also see a significant improvement. An issue regarding slow creation of temp-files in directories with a lot of entries has been fixed in that release [1], and that sounds like it might be related. So that's one of the reasons why your 1.7.7-client is faster (and WC-NG also helps a lot of course). The next release, 1.8, will contain further performance improvements, reducing I/O (both client- and server-side). But the work continues of course ... (and contributions are always welcome ;-). [1] http://subversion.tigris.org/issues/show_bug.cgi?id=3719 - Extremely slow checkout on Windows -- Johan