Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 13291200B49 for ; Wed, 3 Aug 2016 22:58:00 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0EC76160A86; Wed, 3 Aug 2016 20:58:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3068D160A5D for ; Wed, 3 Aug 2016 22:57:59 +0200 (CEST) Received: (qmail 23966 invoked by uid 500); 3 Aug 2016 20:57:58 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 23956 invoked by uid 99); 3 Aug 2016 20:57:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Aug 2016 20:57:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id CF6D4180481 for ; Wed, 3 Aug 2016 20:57:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.18 X-Spam-Level: * X-Spam-Status: No, score=1.18 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=teralytics.ch Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id cptJrMRN-E7T for ; Wed, 3 Aug 2016 20:57:55 +0000 (UTC) Received: from mail-vk0-f49.google.com (mail-vk0-f49.google.com [209.85.213.49]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 014F75FBBE for ; Wed, 3 Aug 2016 20:57:54 +0000 (UTC) Received: by mail-vk0-f49.google.com with SMTP id n129so154797939vke.3 for ; Wed, 03 Aug 2016 13:57:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=teralytics.ch; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=z7TOGlYzUIExN8iRw68PkQ1Hxfh2y3sdd7DPzOXtW94=; b=gvvMWPSIV9/d5H+eEiND0K2RBSulJKqzPQc8QCisap/y/TwOjPWEEuCCHVLP9pCLhK e5hbG3xhC8EhKy4sov2K10YQcrVaO0XHxDt3tDhZiFuoYv4lFpszPpMG/Z02iQIqRUNR msQSmIQcTuBdCm6heckXceA6SSQP/KqakrAaI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=z7TOGlYzUIExN8iRw68PkQ1Hxfh2y3sdd7DPzOXtW94=; b=HwYDkfh+Pjrcm/fz1scLUpjSiF6lqv+44AKE8Lik1w1BITxMRPHs4DNh1hLNs3BB8o VNxxfrGofUzWfMZhPX7Cypz0ObOSIiaUJV7aQLmNBLUTTb6i/W1bWSQoPzMYkH5kxxRm PPSREM6lJW0OAWcmKOLf9FP2SucREPXQGv6qJfCBks+vQ4e1cfmPBnXkh9H6OP+dGS28 S2KxOpT9R+YOIDN3az4AdMRzTFDmk2P6XnRS32+3seKu1rUyIyd6EILuFmdiZ4YYwMtK J0218gV4lmibWlYHuN5HlhM7WykkR5bwanwa4ql9NUoh4ehHWaOVfgqzm3nG8kgolCUz 8vbA== X-Gm-Message-State: AEkooutXj3FeZyvhA3lN9KQyhHRG0VOVlsjaNexjMcOMI/5kIUI4KMEZUT5MSvMZnXSMK9/kJQJq4L0qPDOd6A== X-Received: by 10.31.87.3 with SMTP id l3mr35497364vkb.22.1470257874134; Wed, 03 Aug 2016 13:57:54 -0700 (PDT) MIME-Version: 1.0 Received: by 10.103.17.195 with HTTP; Wed, 3 Aug 2016 13:57:53 -0700 (PDT) In-Reply-To: References: From: Mario Pastorelli Date: Wed, 3 Aug 2016 22:57:53 +0200 Message-ID: Subject: Re: Testing Spark Job that uses the AccumuloInputFormat To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=001a114c8e5650fa7f0539311623 archived-at: Wed, 03 Aug 2016 20:58:00 -0000 --001a114c8e5650fa7f0539311623 Content-Type: text/plain; charset=UTF-8 I do run a single Mini instance for the entire test suite but I need to destroy and recreate tables for each instance of each test. Out of curiosity: am I doing a huge mistake in using MockInstance to test Accumulo? Because right now I rely mainly on it. On Wed, Aug 3, 2016 at 9:11 PM, Christopher wrote: > On Wed, Aug 3, 2016 at 1:34 PM Mario Pastorelli < > mario.pastorelli@teralytics.ch> wrote: > >> Do you guys know if it is possible to use MockInstance to test Spark >> jobs? It's so much faster... >> >> > Probably not. It's faster, but only by behaving very differently than > Accumulo. It has also largely been neglected. > > To speed things up, it's best to run a single Mini instance with something > like accumulo-maven-plugin, rather than start a new one for each test. > -- Mario Pastorelli | TERALYTICS *software engineer* Teralytics AG | Zollstrasse 62 | 8005 Zurich | Switzerland phone: +41794381682 email: mario.pastorelli@teralytics.ch www.teralytics.net Company registration number: CH-020.3.037.709-7 | Trade register Canton Zurich Board of directors: Georg Polzer, Luciano Franceschina, Mark Schmitz, Yann de Vries This e-mail message contains confidential information which is for the sole attention and use of the intended recipient. Please notify us at once if you think that it may not be intended for you and delete it immediately. --001a114c8e5650fa7f0539311623 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I do run a single Mini instance for the entire test s= uite but I need to destroy and recreate tables for each instance of each te= st.

Out of curiosity: am I doing a huge mistake in using = MockInstance to test Accumulo? Because right now I rely mainly on it.

On Wed,= Aug 3, 2016 at 9:11 PM, Christopher <ctubbsii@apache.org>= wrote:
On Wed, Aug 3, 2016 at 1:34 PM= Mario Pastorelli <mario.pastorelli@teralytics.ch> wrote:
Do you guys know if it is p= ossible to use MockInstance to test Spark jobs? It's so much faster...<= br>

=

Probably not. It's faster, but only by beh= aving very differently than Accumulo. It has also largely been neglected.
To speed things up, it's best to run a single Mini instance with = something like accumulo-maven-plugin, rather than start a new one for each = test.



--
Ma= rio Pastorelli | TERALYTICS

software engineer<= /span>

Ter= alytics AG |=C2=A0Zollstrasse 62 | 8005 Zurich=C2=A0| Switzerland=C2=A0
phone: +41794381682
email: mario.pastorelli@teralytics.ch
www.teralytics.net

Company registration number: CH-020.3= .037.709-7 | Trade register Canton Zurich
Board of directors: Georg Polzer, Luc= iano Franceschina, Mark Schmitz, Yann de Vries

This e-mail message contains confidential i= nformation which is for the sole attention and use of the intended recipient. Please notify us at once = if you think that it may not be intended for you and delete it immediately.

--001a114c8e5650fa7f0539311623--