Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0863317993 for ; Mon, 28 Sep 2015 23:37:57 +0000 (UTC) Received: (qmail 17013 invoked by uid 500); 28 Sep 2015 23:37:56 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 16935 invoked by uid 500); 28 Sep 2015 23:37:56 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 16920 invoked by uid 99); 28 Sep 2015 23:37:56 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Sep 2015 23:37:56 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id E06491A1FB5 for ; Mon, 28 Sep 2015 23:37:55 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.98 X-Spam-Level: ** X-Spam-Status: No, score=2.98 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id mQ5ZUQ7v3yPz for ; Mon, 28 Sep 2015 23:37:51 +0000 (UTC) Received: from mail-qk0-f181.google.com (mail-qk0-f181.google.com [209.85.220.181]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 3C22520515 for ; Mon, 28 Sep 2015 23:37:51 +0000 (UTC) Received: by qkap81 with SMTP id p81so75234279qka.2 for ; Mon, 28 Sep 2015 16:37:43 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=H+Dm0vlhMuTegLVRBotNvPR6/BSbx2yk5HWFZcTBKPo=; b=giOZYgDfkBQ7ISeSRmG5DRsA7tCWp1dkUGBzVR7zXooCk7PLF1aF3WJpytg61WvEjt WMlQn1Dt0W3M4KU20MjcmddwH2DP/FqrMMizpzn8JZYQGgg3uMd9adkOZ3SKUgYMtUYj irxLXpuH4ilehjY8prnZSMdm5angLF5XLzpdlwXNFfxIGZWUL+gKhhO/3js9+igIbX5J utMkeF7c3IXTLp/e8VH8F+eNQkP5RHPbJxtiWNn26nolWcCdav1bFSeYmPcizR7GSPqR txe59qaJKwkQ3tHvT7sbawKOO2MBT4NIcITF0Emnq9+maDfYRJbFD5+9r1wcbjrz4FUC LK/Q== X-Gm-Message-State: ALoCoQnhLBIA7ddqfiJEx5fvndsqu9viVmH1LEZfxqgisWuKbUUXFnurgY/m1FfQ9Gne9S9p9ZLW X-Received: by 10.55.197.69 with SMTP id p66mr24814356qki.59.1443483463707; Mon, 28 Sep 2015 16:37:43 -0700 (PDT) MIME-Version: 1.0 Received: by 10.140.44.10 with HTTP; Mon, 28 Sep 2015 16:37:24 -0700 (PDT) In-Reply-To: References: From: Szehon Ho Date: Mon, 28 Sep 2015 16:37:24 -0700 Message-ID: Subject: Re: Splitting tests in PTest2 To: "dev@hive.apache.org" Content-Type: multipart/alternative; boundary=001a1149cc8e1825140520d72ffd --001a1149cc8e1825140520d72ffd Content-Type: text/plain; charset=UTF-8 Yes thanks for looking into it. Can you edit testconfiguration.properties to add a section for LlapCliDriver tests, see HIVE-7254 for details. That way the framework can identify which tests it needs to run and then split it into parallel batches across test nodes. Otherwise it will just run all of the LlapCliDriver tests using -Dtest=TestMiniLlapCliDriver in one huge batch. Once you finish, let me know and I'll tweak the test properties to set a batch size for that one. Thanks Szehon On Mon, Sep 28, 2015 at 4:23 PM, Prasanth Jayachandran wrote: > Hello everyone > > Regarding HIVE-11642, the tests for MiniLlapCliDriver are not split across > multiple nodes. I can see from the logs that MiniTezCliDriver are broken > down into many tests and ran on different machines. > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5447/test-results/ > < > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-5447/test-results/ > > > > How can we do the same for MiniLlapCliDriver tests? Do we need to do > something in PTest2 to enable splitting of tests? > MiniLlapCliDriver runs the same tests are MiniTez but in llap mode. > > Thanks > Prasanth --001a1149cc8e1825140520d72ffd--