Return-Path: X-Original-To: apmail-incubator-connectors-commits-archive@minotaur.apache.org Delivered-To: apmail-incubator-connectors-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B14EC920B for ; Mon, 19 Sep 2011 11:59:14 +0000 (UTC) Received: (qmail 8949 invoked by uid 500); 19 Sep 2011 11:59:14 -0000 Delivered-To: apmail-incubator-connectors-commits-archive@incubator.apache.org Received: (qmail 8896 invoked by uid 500); 19 Sep 2011 11:59:14 -0000 Mailing-List: contact connectors-commits-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: connectors-dev@incubator.apache.org Delivered-To: mailing list connectors-commits@incubator.apache.org Received: (qmail 8888 invoked by uid 99); 19 Sep 2011 11:59:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Sep 2011 11:59:14 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Sep 2011 11:59:11 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id 1E65323888FD; Mon, 19 Sep 2011 11:58:50 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1172580 - in /incubator/lcf/trunk: ./ framework/core/src/test/java/org/apache/manifoldcf/core/tests/ loadtests/filesystem/src/test/java/org/apache/manifoldcf/filesystem_loadtests/ site/src/documentation/content/xdocs/ Date: Mon, 19 Sep 2011 11:58:49 -0000 To: connectors-commits@incubator.apache.org From: kwright@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20110919115850.1E65323888FD@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: kwright Date: Mon Sep 19 11:58:49 2011 New Revision: 1172580 URL: http://svn.apache.org/viewvc?rev=1172580&view=rev Log: Get the load test working. CONNECTORS-87. Modified: incubator/lcf/trunk/CHANGES.txt incubator/lcf/trunk/framework/core/src/test/java/org/apache/manifoldcf/core/tests/BasePostgresql.java incubator/lcf/trunk/loadtests/filesystem/src/test/java/org/apache/manifoldcf/filesystem_loadtests/BigCrawlPostgresqlTest.java incubator/lcf/trunk/site/src/documentation/content/xdocs/performance-tuning.xml Modified: incubator/lcf/trunk/CHANGES.txt URL: http://svn.apache.org/viewvc/incubator/lcf/trunk/CHANGES.txt?rev=1172580&r1=1172579&r2=1172580&view=diff ============================================================================== --- incubator/lcf/trunk/CHANGES.txt (original) +++ incubator/lcf/trunk/CHANGES.txt Mon Sep 19 11:58:49 2011 @@ -3,6 +3,9 @@ $Id$ ======================= 0.4-dev ===================== +CONNECTORS-87: Add a framework load test. +(Karl Wright) + CONNECTORS-255: Add ability to process site map documents, in both RSS connector and Web connector. (Karl Wright) Modified: incubator/lcf/trunk/framework/core/src/test/java/org/apache/manifoldcf/core/tests/BasePostgresql.java URL: http://svn.apache.org/viewvc/incubator/lcf/trunk/framework/core/src/test/java/org/apache/manifoldcf/core/tests/BasePostgresql.java?rev=1172580&r1=1172579&r2=1172580&view=diff ============================================================================== --- incubator/lcf/trunk/framework/core/src/test/java/org/apache/manifoldcf/core/tests/BasePostgresql.java (original) +++ incubator/lcf/trunk/framework/core/src/test/java/org/apache/manifoldcf/core/tests/BasePostgresql.java Mon Sep 19 11:58:49 2011 @@ -99,6 +99,11 @@ public class BasePostgresql " \n" + " \n" + " \n" + + " \n" + + " \n" + + " \n" + + " \n" + + " \n" + " \n" + "\n"); Modified: incubator/lcf/trunk/loadtests/filesystem/src/test/java/org/apache/manifoldcf/filesystem_loadtests/BigCrawlPostgresqlTest.java URL: http://svn.apache.org/viewvc/incubator/lcf/trunk/loadtests/filesystem/src/test/java/org/apache/manifoldcf/filesystem_loadtests/BigCrawlPostgresqlTest.java?rev=1172580&r1=1172579&r2=1172580&view=diff ============================================================================== --- incubator/lcf/trunk/loadtests/filesystem/src/test/java/org/apache/manifoldcf/filesystem_loadtests/BigCrawlPostgresqlTest.java (original) +++ incubator/lcf/trunk/loadtests/filesystem/src/test/java/org/apache/manifoldcf/filesystem_loadtests/BigCrawlPostgresqlTest.java Mon Sep 19 11:58:49 2011 @@ -83,6 +83,7 @@ public class BigCrawlPostgresqlTest exte e.printStackTrace(); throw e; } + System.out.println("Done generating files"); } @After @@ -102,7 +103,7 @@ public class BigCrawlPostgresqlTest exte } @Test - public void sanityCheck() + public void bigCrawl() throws Exception { try Modified: incubator/lcf/trunk/site/src/documentation/content/xdocs/performance-tuning.xml URL: http://svn.apache.org/viewvc/incubator/lcf/trunk/site/src/documentation/content/xdocs/performance-tuning.xml?rev=1172580&r1=1172579&r2=1172580&view=diff ============================================================================== --- incubator/lcf/trunk/site/src/documentation/content/xdocs/performance-tuning.xml (original) +++ incubator/lcf/trunk/site/src/documentation/content/xdocs/performance-tuning.xml Mon Sep 19 11:58:49 2011 @@ -92,7 +92,7 @@ The properties.xml parameter that controls this is org.apache.manifoldcf.database.maxhandles. The formula you should use to properly set the value is below.

-

worker_thread_count + delete_thread_count + expiration_thread_count + 10 < manifoldcf_db_pool_size

+

worker_thread_count + delete_thread_count + expiration_thread_count + cleanup_thread_count + 10 < manifoldcf_db_pool_size