Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 372E2200C1D for ; Thu, 16 Feb 2017 21:49:56 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 32907160B61; Thu, 16 Feb 2017 20:49:56 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2DD79160B52 for ; Thu, 16 Feb 2017 21:49:55 +0100 (CET) Received: (qmail 41435 invoked by uid 500); 16 Feb 2017 20:49:54 -0000 Mailing-List: contact notifications-help@asterixdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@asterixdb.apache.org Delivered-To: mailing list notifications@asterixdb.apache.org Received: (qmail 41426 invoked by uid 99); 16 Feb 2017 20:49:54 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Feb 2017 20:49:54 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id F08A51804C1 for ; Thu, 16 Feb 2017 20:49:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.127 X-Spam-Level: ** X-Spam-Status: No, score=2.127 tagged_above=-999 required=6.31 tests=[MISSING_HEADERS=1.207, SPF_FAIL=0.919, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id JOxuN3CLj2bO for ; Thu, 16 Feb 2017 20:49:52 +0000 (UTC) Received: from unhygienix.ics.uci.edu (unhygienix.ics.uci.edu [128.195.14.130]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 9FB5E5F54F for ; Thu, 16 Feb 2017 20:49:51 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by unhygienix.ics.uci.edu (Postfix) with ESMTP id 3C52324206D; Thu, 16 Feb 2017 12:49:51 -0800 (PST) Date: Thu, 16 Feb 2017 12:49:51 -0800 From: "Yingyi Bu (Code Review)" CC: Jenkins , Till Westmann , Ian Maxon , Michael Blow Reply-To: buyingyi@gmail.com X-Gerrit-MessageType: merged Subject: Change in asterixdb[master]: Add cluster performance testing scripts. X-Gerrit-Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb X-Gerrit-ChangeURL: X-Gerrit-Commit: 73715d87802b6da9916aa094b06d66bb40b47ced In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.12.7 Message-Id: <20170216204951.3C52324206D@unhygienix.ics.uci.edu> archived-at: Thu, 16 Feb 2017 20:49:56 -0000 Yingyi Bu has submitted this change and it was merged. Change subject: Add cluster performance testing scripts. ...................................................................... Add cluster performance testing scripts. - Wait SSH instead of sleep in the AWS installation script; - Remove Java code and generate config files in Ansible; - TPC-H is one benchmark, and more benchmarks could be added into the framework. Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb Reviewed-on: https://asterix-gerrit.ics.uci.edu/1504 Sonar-Qube: Jenkins Tested-by: Jenkins Reviewed-by: Till Westmann --- A asterixdb/asterix-benchmark/pom.xml A asterixdb/asterix-benchmark/src/main/assembly/binary-assembly.xml A asterixdb/asterix-benchmark/src/main/resources/ansible/runquery.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/compile.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/gen.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/gendata.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/genscript.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/settings.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/gendml_centralized.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/gendml_partitioned.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/load.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/loadgen.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/settings.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/template.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q1.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q10.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q11.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q12.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q13.sqlpp C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q14.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q15.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q16.sqlpp C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q17.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q18.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q19.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q2.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q20.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q21.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q22.sqlpp.dis C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q3.sqlpp C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q4.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q5.sqlpp.dis R asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q6.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q7.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q8.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q9.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/setup/create.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/setup/setup.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/teardown/drop.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/teardown/teardown.yml A asterixdb/asterix-benchmark/src/main/resources/bin/runall.sh A asterixdb/asterix-benchmark/src/main/resources/conf/benchmark_setting.yml D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q01_pricing_summary_report_nt.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q02_minimum_cost_supplier.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q03_shipping_priority_nt.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q04_order_priority.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q05_local_supplier_volume.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q07_volume_shipping.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q08_national_market_share.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q09_product_type_profit_nt.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q10_returned_item.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q11_important_stock.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q12_shipping.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q13_customer_distribution.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q14_promotion_effect.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q15_top_supplier.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q16_parts_supplier_relationship.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q17_small_quantity_order_revenue.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q18_large_volume_customer.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q19_discounted_revenue.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q20_potential_part_promotion.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q21_suppliers_who_kept_orders_waiting.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q21_suppliers_who_kept_orders_waiting.3.query_2.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q22_global_sales_opportunity.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q01_pricing_summary_report_nt.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q02_minimum_cost_supplier.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q03_shipping_priority_nt.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q04_order_priority.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q06_forecast_revenue_change.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q07_volume_shipping.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q10_returned_item.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q11_important_stock.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q12_shipping.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q13_customer_distribution.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q15_top_supplier.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q16_parts_supplier_relationship.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q17_small_quantity_order_revenue.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q20_potential_part_promotion.3.query.adm M asterixdb/asterix-server/pom.xml D asterixdb/asterix-server/src/main/java/org/apache/asterixdb/aws/AwsNode.java D asterixdb/asterix-server/src/main/java/org/apache/asterixdb/aws/ConfigGenerator.java M asterixdb/asterix-server/src/main/opt/aws/README M asterixdb/asterix-server/src/main/opt/aws/ansible/aws_start.yml M asterixdb/asterix-server/src/main/opt/aws/ansible/instance_start.yml M asterixdb/asterix-server/src/main/opt/aws/bin/start.sh M asterixdb/asterix-server/src/main/opt/aws/conf/aws_settings.yml M asterixdb/asterix-server/src/main/opt/aws/conf/instance_settings.yml M asterixdb/pom.xml 88 files changed, 1,877 insertions(+), 21,374 deletions(-) Approvals: Till Westmann: Looks good to me, approved Jenkins: Verified; No violations found Objections: Jenkins: Violations found -- To view, visit https://asterix-gerrit.ics.uci.edu/1504 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi Bu Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Michael Blow Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: Yingyi Bu