From dev-return-23783-apmail-geode-dev-archive=geode.apache.org@geode.apache.org Fri Jun 16 00:59:57 2017 Return-Path: X-Original-To: apmail-geode-dev-archive@minotaur.apache.org Delivered-To: apmail-geode-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7A7FB1A79C for ; Fri, 16 Jun 2017 00:59:57 +0000 (UTC) Received: (qmail 35514 invoked by uid 500); 16 Jun 2017 00:59:57 -0000 Delivered-To: apmail-geode-dev-archive@geode.apache.org Received: (qmail 35459 invoked by uid 500); 16 Jun 2017 00:59:57 -0000 Mailing-List: contact dev-help@geode.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@geode.apache.org Delivered-To: mailing list dev@geode.apache.org Received: (qmail 35447 invoked by uid 99); 16 Jun 2017 00:59:55 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Jun 2017 00:59:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 77FFEC05B0; Fri, 16 Jun 2017 00:59:55 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3 X-Spam-Level: *** X-Spam-Status: No, score=3 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id O3z891wFQeNS; Fri, 16 Jun 2017 00:59:54 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 464C25FAE1; Fri, 16 Jun 2017 00:59:53 +0000 (UTC) Received: from reviews.apache.org (unknown [10.41.0.12]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 8847CE01D8; Fri, 16 Jun 2017 00:59:52 +0000 (UTC) Received: from reviews-vm2.apache.org (localhost [IPv6:::1]) by reviews.apache.org (ASF Mail Server at reviews-vm2.apache.org) with ESMTP id E9E83C403C1; Fri, 16 Jun 2017 00:59:51 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============5344593860829184731==" MIME-Version: 1.0 Subject: Review Request 60142: GEODE-3071: Provide capability to parallelize distributedTests From: Jens Deppe To: Dan Smith , Anthony Baker , Mark Bretl Cc: geode , Jens Deppe Date: Fri, 16 Jun 2017 00:59:51 -0000 Message-ID: <20170616005951.14818.35928@reviews-vm2.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: Jens Deppe X-ReviewGroup: geode X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/60142/ X-Sender: Jens Deppe X-ReviewBoard-Diff-For: gradle/docker.gradle Reply-To: Jens Deppe X-ReviewRequest-Repository: geode --===============5344593860829184731== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60142/ ----------------------------------------------------------- Review request for geode, Anthony Baker, Mark Bretl, and Dan Smith. Repository: geode Description ------- Herewith the ability to leverage Gradle's parallel test execution capability to run dunits in parallel. This is combined with launching tests in Docker containers to provide process, network and filesystem isolation. Depending on the size of your system, this can speed up running the distributedTest task 2-5 times. The capability is enabled by launching gradle with '-PparallelDunit' Tunables, enabled as gradle parametrs (-P option) are: - dunitDockerImage: The docker image which will be used to launch tests. The image must have the JAVA_HOME environment variable set. The image must be pulled locally before starting the tests. - dunitParallelForks: The number of parallel docker containers to be launched. - dunitDockerUser: The docker user which will run the tests. Because of the way that the containers map the build directory into them, the test artifacts, will be written with this user id. By default this is 'root'. Remove debug println NOTE: There are problems running this on MacOS which will require a bit more work. Diffs ----- build.gradle ec6b920c825491030120e99d288067d476d1fdcb gradle.properties ca79a3816bffa56e412d82dd570f1e0e445592be gradle/docker.gradle PRE-CREATION Diff: https://reviews.apache.org/r/60142/diff/1/ Testing ------- Manual test on linux Thanks, Jens Deppe --===============5344593860829184731==--