Return-Path: X-Original-To: apmail-subversion-users-archive@minotaur.apache.org Delivered-To: apmail-subversion-users-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 48E7010753 for ; Thu, 1 Aug 2013 16:21:18 +0000 (UTC) Received: (qmail 98161 invoked by uid 500); 1 Aug 2013 16:21:17 -0000 Delivered-To: apmail-subversion-users-archive@subversion.apache.org Received: (qmail 97713 invoked by uid 500); 1 Aug 2013 16:21:11 -0000 Mailing-List: contact users-help@subversion.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list users@subversion.apache.org Received: (qmail 97700 invoked by uid 99); 1 Aug 2013 16:21:09 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Aug 2013 16:21:09 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of thomas-lists@nybeta.com designates 207.97.179.66 as permitted sender) Received: from [207.97.179.66] (HELO mail.nybeta.com) (207.97.179.66) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Aug 2013 16:21:04 +0000 Received: from amavisd.intra.nybeta.com (unknown [127.0.0.1]) by mail.nybeta.com (Postfix) with ESMTP id B73004032D for ; Thu, 1 Aug 2013 16:20:43 +0000 (UTC) X-Virus-Scanned: amavisd-new at nybeta.com Received: from mail.nybeta.com ([127.0.0.1]) by amavisd.intra.nybeta.com (mail.nybeta.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JzGnStDIG5_q for ; Thu, 1 Aug 2013 12:20:43 -0400 (EDT) Received: from [172.30.6.202] (unknown [172.30.6.202]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: thomas-lists@nybeta.com) by mail.nybeta.com (Postfix) with ESMTPSA id 8589C40028 for ; Thu, 1 Aug 2013 12:20:42 -0400 (EDT) Message-ID: <51FA8AD5.5030304@nybeta.com> Date: Thu, 01 Aug 2013 12:20:37 -0400 From: Thomas Harold User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130620 Thunderbird/17.0.7 MIME-Version: 1.0 To: users@subversion.apache.org Subject: Re: SVN performance -URGENT References: <89B0C95CD328394BB944FB8C18E18127DF705D@Sxim-005.fg.rbc.com> <89B0C95CD328394BB944FB8C18E18127DF7068@Sxim-005.fg.rbc.com> In-Reply-To: <89B0C95CD328394BB944FB8C18E18127DF7068@Sxim-005.fg.rbc.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org On 8/1/2013 10:52 AM, Somashekarappa, Anup (CWM-NR) wrote: > Bandwidth is 35.4 MBytes/secfrom my system(London) to server(New york) > when i checked with iperf tool. > We are using LDAP > AuthzLDAPAuthoritative off > AuthType Basic > AuthBasicProvider ldap > AuthName "Windows Credentials" > > As per message after checkout in TortoiseSVNGUI = 368 Mbytes transfered. > > Actual folder size = 1.15 GB(1236706079 bytes) > > Number of files = 201,712 > > Folder = 21,707 > > Guess this inculdes the .svn folder as well. > That's a fairly complex working copy with many files/folders. Given that you have 35Mbps (note the lower case B) of bandwidth, an ideal transfer should be somewhere in the 45-60 minute range for a fresh checkout of the entire thing. However, you're obviously bottlenecked somewhere. On the Linux server side, I suggest installing a tool called "atop" and monitoring things like how busy the disks are, how busy the CPU cores are and the network throughput. This will give you an idea of how hard the Linux server is working while sending out the data to the SVN client. For the windows client, you will need to look at the Performance Monitor (perfmon) and Task Manager to see if you are bottlenecking somewhere. Good counters to watch in perfmon are "Physical Disk / % Disk Read Time", "Physical Disk / % Disk Write Time", "Network Interface / Bytes Sent/sec", "Network Interface / Bytes Received/sec". My guesses at this point would be: - You're not using a SSD on the Windows client, so there is a lot of disk activity as SVN goes to create the working copy. So your disks are 100% busy and are your bottleneck. - You're CPU bottlenecked somewhere. Either server-side or client-side. - Maybe you need to consider using sparse working copies or only checking out a portion of the repository at a time. (Such as only bringing down your project's "trunk" folder.) - You'll need to do this checkout once to create the initial working copy, then keep the working copy around for a long time. Future "svn update" commands will then only transmit the changes over the wire instead of all of the content.