Return-Path: X-Original-To: apmail-subversion-commits-archive@minotaur.apache.org Delivered-To: apmail-subversion-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 228A817ABD for ; Wed, 21 Oct 2015 11:36:03 +0000 (UTC) Received: (qmail 30185 invoked by uid 500); 21 Oct 2015 11:36:02 -0000 Delivered-To: apmail-subversion-commits-archive@subversion.apache.org Received: (qmail 30156 invoked by uid 500); 21 Oct 2015 11:36:02 -0000 Mailing-List: contact commits-help@subversion.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@subversion.apache.org Delivered-To: mailing list commits@subversion.apache.org Received: (qmail 30146 invoked by uid 99); 21 Oct 2015 11:36:02 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Oct 2015 11:36:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 4784D1809A8 for ; Wed, 21 Oct 2015 11:36:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.99 X-Spam-Level: X-Spam-Status: No, score=0.99 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id rn78XTD4OQSs for ; Wed, 21 Oct 2015 11:36:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTP id CA9E720594 for ; Wed, 21 Oct 2015 11:36:00 +0000 (UTC) Received: from svn01-us-west.apache.org (svn.apache.org [10.41.0.6]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id C7177E0279 for ; Wed, 21 Oct 2015 11:35:59 +0000 (UTC) Received: from svn01-us-west.apache.org (localhost [127.0.0.1]) by svn01-us-west.apache.org (ASF Mail Server at svn01-us-west.apache.org) with ESMTP id 3B5B33A0337 for ; Wed, 21 Oct 2015 11:35:59 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1709799 - /subversion/trunk/subversion/libsvn_fs_fs/fs_fs.c Date: Wed, 21 Oct 2015 11:35:58 -0000 To: commits@subversion.apache.org From: stefan2@apache.org X-Mailer: svnmailer-1.0.9 Message-Id: <20151021113559.3B5B33A0337@svn01-us-west.apache.org> Author: stefan2 Date: Wed Oct 21 11:35:58 2015 New Revision: 1709799 URL: http://svn.apache.org/viewvc?rev=1709799&view=rev Log: Increase the default revprop pack size in FSFS from 4k to 16k. Given that the manifest file is typically 8k to 10k already, the increase in data transfer and processing overhead for random, uncached access is a moderate 50%. The revprop prefetching / temporary buffering needs fewer manifest reads and fopen calls now such that the total CPU will actually go down in typical scenarios. On the physical side of things, we see a significant reduction in file count, which reduces random I/O and the cost of copying repositories. * subversion/libsvn_fs_fs/fs_fs.c (read_config): Increase the pack file size defaults by a factor of 4. (write_config): Update the docstring on the fsfs.conf template. Modified: subversion/trunk/subversion/libsvn_fs_fs/fs_fs.c Modified: subversion/trunk/subversion/libsvn_fs_fs/fs_fs.c URL: http://svn.apache.org/viewvc/subversion/trunk/subversion/libsvn_fs_fs/fs_fs.c?rev=1709799&r1=1709798&r2=1709799&view=diff ============================================================================== --- subversion/trunk/subversion/libsvn_fs_fs/fs_fs.c (original) +++ subversion/trunk/subversion/libsvn_fs_fs/fs_fs.c Wed Oct 21 11:35:58 2015 @@ -754,8 +754,8 @@ read_config(fs_fs_data_t *ffd, CONFIG_SECTION_PACKED_REVPROPS, CONFIG_OPTION_REVPROP_PACK_SIZE, ffd->compress_packed_revprops - ? 0x10 - : 0x4)); + ? 0x40 + : 0x10)); ffd->revprop_pack_size *= 1024; } @@ -962,9 +962,9 @@ write_config(svn_fs_t *fs, "### latency and CPU usage reading and changing individual revprops." NL "### Values smaller than 4 kByte will not improve latency any further and " NL "### quickly render revprop packing ineffective." NL -"### revprop-pack-size is 4 kBytes by default for non-compressed revprop" NL -"### pack files and 16 kBytes when compression has been enabled." NL -"# " CONFIG_OPTION_REVPROP_PACK_SIZE " = 4" NL +"### revprop-pack-size is 16 kBytes by default for non-compressed revprop" NL +"### pack files and 64 kBytes when compression has been enabled." NL +"# " CONFIG_OPTION_REVPROP_PACK_SIZE " = 16" NL "###" NL "### To save disk space, packed revprop files may be compressed. Standard" NL "### revprops tend to allow for very effective compression. Reading and" NL