From dev-return-37615-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Thu Aug 9 17:52:00 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 0653C18065B for ; Thu, 9 Aug 2018 17:51:59 +0200 (CEST) Received: (qmail 16838 invoked by uid 500); 9 Aug 2018 15:51:59 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 16827 invoked by uid 99); 9 Aug 2018 15:51:59 -0000 Received: from mail-relay.apache.org (HELO mailrelay2-lw-us.apache.org) (207.244.88.137) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2018 15:51:59 +0000 Received: from mail-io0-f170.google.com (mail-io0-f170.google.com [209.85.223.170]) by mailrelay2-lw-us.apache.org (ASF Mail Server at mailrelay2-lw-us.apache.org) with ESMTPSA id 4538C1FA9 for ; Thu, 9 Aug 2018 15:51:58 +0000 (UTC) Received: by mail-io0-f170.google.com with SMTP id q4-v6so5143062iob.8 for ; Thu, 09 Aug 2018 08:51:58 -0700 (PDT) X-Gm-Message-State: AOUpUlEz7wyOwLjdQ7oNkywtjhvWtgYV5PC8L/7a9VFUQkW/z58p/9bK Ia8tg47J4JJkjiIEXLXcDROzR11XmS01wtk5P5I= X-Google-Smtp-Source: AA+uWPwdSjnLQtWRb5in6QBK5sj6f5QQ5uuXg3AtYTHH8OW8bc7/khuYH4mwd6ZkYbXcaGej5jReXYzgg7FsVWHQn5o= X-Received: by 2002:a6b:6905:: with SMTP id e5-v6mr2269658ioc.6.1533829917712; Thu, 09 Aug 2018 08:51:57 -0700 (PDT) MIME-Version: 1.0 From: Anton Vinogradov Date: Thu, 9 Aug 2018 18:51:46 +0300 X-Gmail-Original-Message-ID: Message-ID: Subject: Benchmarking To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary="000000000000642c150573029ba5" --000000000000642c150573029ba5 Content-Type: text/plain; charset="UTF-8" Igniters, All critical code changes should be covered by benchmarks. Currently, community have no dedicated benchmarking service. Everyone can run yandstick locally, but this seems to be useless. You have to run cluster on 4 clients and 4 servers, at least. Currently it is not possible for me to perform benchmarking using 8+ real servers. Also, some automation requred to have reliable check of two branchs with one feature difference, since yardstick will provide you branch check, not a branches comparision. So, my question is: Is there anybody at community able to perform benchmarks on real hardware and already have automation to compare 2 branches? --000000000000642c150573029ba5--