From user-return-811-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Fri Nov 20 01:07:55 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id C8414180637 for ; Fri, 20 Nov 2020 02:07:55 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id 0E2E268A34 for ; Fri, 20 Nov 2020 01:07:54 +0000 (UTC) Received: (qmail 17284 invoked by uid 500); 20 Nov 2020 01:07:53 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 17273 invoked by uid 99); 20 Nov 2020 01:07:53 -0000 Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org) (95.217.134.168) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Nov 2020 01:07:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org) with ESMTP id 74D7DC0442 for ; Fri, 20 Nov 2020 01:07:52 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org X-Spam-Flag: NO X-Spam-Score: -0.098 X-Spam-Level: X-Spam-Status: No, score=-0.098 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, SPF_NONE=0.001] autolearn=disabled Authentication-Results: spamproc1-he-fi.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new, port 10024) with ESMTP id AlJJk4T8mDtz for ; Fri, 20 Nov 2020 01:07:52 +0000 (UTC) Received-SPF: None (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::629; helo=mail-pl1-x629.google.com; envelope-from=fsaintjacques@networkdump.com; receiver= Received: from mail-pl1-x629.google.com (mail-pl1-x629.google.com [IPv6:2607:f8b0:4864:20::629]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id B71307E151 for ; Fri, 20 Nov 2020 01:07:51 +0000 (UTC) Received: by mail-pl1-x629.google.com with SMTP id t18so3984048plo.0 for ; Thu, 19 Nov 2020 17:07:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=29uXulm5m+RahnPszHAZ4mnoU4c0e+pKALFSpd+lloQ=; b=p7po17yYpl5iMk4MnfQI++9TMeWUvfb4irXioeA7/jNtdeWCl4eJz6Hus+UL0Ej2nC g4+FiI/XMTh8zt6S+lLViKu5j2Fkj+LYKil4yxaVkPN56cWuXfVIWjBmX3nemTGCXT0i yyvU57hkOBbQrs37Xs3RLaDfckIMmM5/bIm/hj1XkVxT5n670lgCOAPBdntcETldWYak E3XDsI4Pn4QEF2Iev8s771I8qTLdHUNHCCnO9l9WLMZrpp+qxbBPXRQz413PZXwbgraJ ZuIRu25Jdd22q0+T4Ye+ZGulCawOGd7Y30jd32gQ+xbJsxW/k6QrzCBEGq/EkT5KbbCS wKQA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=29uXulm5m+RahnPszHAZ4mnoU4c0e+pKALFSpd+lloQ=; b=BFS08WYHZwDJhJ/SQSLbDwpG1CmQluiFZ0kiev6f4wCB6HtwaYko0c9uxnBlNwTq+H FWE3E+652v9NZv70mrRCO8+YTPu5eEXt/noAQ39nUrJJHjFtkQOTusM8MjlZWwF+XMmi Ge5PSRoV0GgKvwgooIqoFB4lHRXmmzOAqL+2CMPNGfXCeq++HGT0QDtm0t9xpSZ6Z54s A+m/0dQE+O7L+4GwknfgT+RM4OGpqplzZPbrJpl5AnnDZjlav7OLu/EDR4joy54lkiik XymumLuAg/7v4g+4sf5gjYvPXXoD+5PcGl7wJEF+GWpag7SGUg/wfRwQ3RPGxlk1L7as lYuA== X-Gm-Message-State: AOAM533sO+wJW9QB8PxN7r/5hZCU1Qpa5J0ed129xlk0cYzh0vc9zsc6 hFdGXtxfUQu6EP5mM/bbZ+y7ca1BbPBSl5bNw4MmMiCEeLo= X-Google-Smtp-Source: ABdhPJzrLeKU6Yot3/V4DEbXg22wdxGwf6Q2oif+43Bo9Rag9r6FtNLh8X++2tYc0ukxNP3BA51W++enWIoWWV2k5/4= X-Received: by 2002:a17:902:ba8b:b029:d7:e6da:cd21 with SMTP id k11-20020a170902ba8bb02900d7e6dacd21mr11383910pls.38.1605834469617; Thu, 19 Nov 2020 17:07:49 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Francois Saint-Jacques Date: Thu, 19 Nov 2020 20:07:38 -0500 Message-ID: Subject: Re: Archery benchmark not using multicore while running tests. To: user@arrow.apache.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello Kiel, This is on purpose (unless the test is explicitly testing multi-core). The goal is to minimize the variance of micro-benchmarks due to the effect of turbo-boost, downclocking or even memory bandwidth congestion. I recall that some tests were very particularly affected by this. An improved approach could be to study and find such tests and mark them to run with a "global-lock". Fran=C3=A7ois On Thu, Nov 19, 2020 at 4:54 PM Kiel Friedt wrote: > > Hi All, > > > > I am benchmarking using archery and during the initial build I do see man= y cores are used for building. Averaging around 60% on a 8 core machine. Bu= t after building only a single core is used. How can I allow tests to run a= nd utilize all cores on my system? > > > > Kiel > > > > IMPORTANT NOTICE: The contents of this email and any attachments are conf= idential and may also be privileged. If you are not the intended recipient,= please notify the sender immediately and do not disclose the contents to a= ny other person, use it for any purpose, or store or copy the information i= n any medium. Thank you.