Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 8D116200B21 for ; Fri, 10 Jun 2016 16:54:02 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 8BA0A160A5A; Fri, 10 Jun 2016 14:54:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D34EA160A15 for ; Fri, 10 Jun 2016 16:54:01 +0200 (CEST) Received: (qmail 18875 invoked by uid 500); 10 Jun 2016 14:54:01 -0000 Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list dev@accumulo.apache.org Received: (qmail 18855 invoked by uid 99); 10 Jun 2016 14:54:00 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jun 2016 14:54:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 48026C0DD6 for ; Fri, 10 Jun 2016 14:54:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.511 X-Spam-Level: ** X-Spam-Status: No, score=2.511 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id QsgH3fj69DjL for ; Fri, 10 Jun 2016 14:53:58 +0000 (UTC) Received: from mail-io0-f173.google.com (mail-io0-f173.google.com [209.85.223.173]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 5796A5F46E for ; Fri, 10 Jun 2016 14:53:57 +0000 (UTC) Received: by mail-io0-f173.google.com with SMTP id 5so67637444ioy.1 for ; Fri, 10 Jun 2016 07:53:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=WSoZtGt+4UVATmXP8z6/KCXi2ZsOIQtmACjmYojl/1s=; b=qvc/aZSiRrAzJ8JvnYY4d1T5xEpW2E4M23ulDKXRT8wMvFP9ruCKHViYR7QXDDFTgd GfFgATlLnIeqc37W/OEjIne8CG9/auQPzhrvEmGcx7ULiExmDsHCMc4B5r0DF3vSIFkQ rzmL6B2uJGCk+tDPojfFdEzaHshzEVNxlPoXwxE+ohO/9kwSlB+xOgNz80chEqHwYM6p pgG1ois3Xjtb8cTpAqUjmZdQGt1uT+NhDJ/HGGV9dBJ9RqYxCO8VP44XMihP2uR88+Ef 5nJAIim3t4IkPMkVhYjzU5wk37jxv6ECjnjhpMFpGhe1yK2yTQgXaom/YG88yXkV99GW J0PA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=WSoZtGt+4UVATmXP8z6/KCXi2ZsOIQtmACjmYojl/1s=; b=KC7nRoNTYLzSwg7DO+X/9Kxbu0HvXgpWwLSCB5clxKEsrPb+wvXYVYDJWQoayoHmFG wC2coIOWA6JSh97r1akcARu8avYo1NjEPH2fs9CUP190BJMYjIVOx4/TN/HH7PfQCq6E DbQaHMg1N/3UeKpUvth8I5w7ghksAM1S1aWPpGIpFBrfsgUpWnw9/uHXqEJ/T3mgHaKm M5Y11sVyVfVAa+ThHFemaqAm7FiXP29El8FpGr9wA6Qdkrius2XKDj/bU1dYA2aP+swT Q45Bn9U24YExKYt91iwGr4BsLP1xBHN9j4aEtmKGJAV/6HZe4vL7SJsOuQ2NY1RIAS5a Elgw== X-Gm-Message-State: ALyK8tI27+dkoEe51ZbAPQscgacEfilZIdwT9Tr8HgmxrATK9bxaMyw/Slsa2N1uCuJ3LvPc0deOTi92u7dwjw== X-Received: by 10.107.159.84 with SMTP id i81mr4458999ioe.29.1465570436249; Fri, 10 Jun 2016 07:53:56 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.138.197 with HTTP; Fri, 10 Jun 2016 07:53:55 -0700 (PDT) In-Reply-To: <1465565739290-17245.post@n5.nabble.com> References: <1465565739290-17245.post@n5.nabble.com> From: William Slacum Date: Fri, 10 Jun 2016 16:53:55 +0200 Message-ID: Subject: Re: measuring perf To: dev Content-Type: multipart/alternative; boundary=001a1140b8ec3f23250534edb58b archived-at: Fri, 10 Jun 2016 14:54:02 -0000 --001a1140b8ec3f23250534edb58b Content-Type: text/plain; charset=UTF-8 I think it's reasonable to measure from the start of a for/while loop over the Scanner. Such as: ``` // .. my initialization code scanner.setRange(someRange) Stopwatch timer = Stopwatch.createStarted(); for(Entry e: scanner) { // my logic } timer.stop(); ``` I've personally done this when measuring query performance and usually gives a good estimate of what's going on, especially if the network has low, constant latency. On Fri, Jun 10, 2016 at 3:35 PM, z11373 wrote: > Good morning! > I have a service running against different Accumulo instance (in different > datacenter). > Both Accumulo should have same configurations, but I was told by consumer > of > my service is they experience one is faster than one in another datacenter. > The service being deployed is running on machine with same spec, and most > operations are against Accumulo, hence I am interested to capture the perf > (including network latency from Accumulo server to my service), and compare > them to verify if the problem is indeed accessing Accumulo instance is > slower than the other one. Right now I capture time from my service being > called and results being returned, but that doesn't tell how much time it > spent on Accumulo. > > Unlike in traditional SQL database, I could measure the time it takes to > run > a SELECT statement for example, but in Accumulo, nothing being read from > server, until we iterate (my understanding may be wrong), so for now I am > thinking perhaps I'd set the start time before setting the ranges, and set > the stop time when there is no more item from that iterator. Is this > reasonable, or perhaps there is a better way? > > For additional info, my service will read from iterator, for each item, it > will make another scanner (and set range), and iterate again, and so on. So > if it ends up with 10 scanners, my current approach will log 10 perf > captures. > > > Thanks, > Z > > > > -- > View this message in context: > http://apache-accumulo.1065345.n5.nabble.com/measuring-perf-tp17245.html > Sent from the Developers mailing list archive at Nabble.com. > --001a1140b8ec3f23250534edb58b--