Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id DCA21200D16 for ; Tue, 26 Sep 2017 04:28:25 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id DB3081609E9; Tue, 26 Sep 2017 02:28:25 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2394F1609BB for ; Tue, 26 Sep 2017 04:28:24 +0200 (CEST) Received: (qmail 18809 invoked by uid 500); 26 Sep 2017 02:28:23 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 18800 invoked by uid 99); 26 Sep 2017 02:28:23 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Sep 2017 02:28:23 +0000 Received: from [10.42.80.128] (outbound.hortonworks.com [192.175.27.2]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 120D01A0185 for ; Tue, 26 Sep 2017 02:28:21 +0000 (UTC) User-Agent: Microsoft-MacOutlook/f.26.0.170902 Date: Mon, 25 Sep 2017 19:28:18 -0700 Subject: Re: Benchmarking Hive ACID functionality From: Gopal Vijayaraghavan To: "user@hive.apache.org" Message-ID: <1255435F-9AEE-46E1-810F-8B399DE9DEFF@hortonworks.com> Thread-Topic: Benchmarking Hive ACID functionality References: <220086032.1960907.1506384378297.ref@mail.yahoo.com> <220086032.1960907.1506384378297@mail.yahoo.com> In-Reply-To: <220086032.1960907.1506384378297@mail.yahoo.com> Mime-version: 1.0 Content-type: text/plain; charset="UTF-8" Content-transfer-encoding: 7bit archived-at: Tue, 26 Sep 2017 02:28:26 -0000 > Are there any frameworks like TPC-DS to benchmark Hive ACID functionality? Are you trying to work on and improve Hive ACID? I have a few ACID micro-benchmarks like this https://github.com/t3rmin4t0r/acid2x-jmh so that I can test the inner loops of ACID without having any ORC data at all. https://issues.apache.org/jira/browse/HIVE-17089 look for this patch in your branch, before you start working on performance improvements Cheers, Gopal