Return-Path: X-Original-To: apmail-accumulo-dev-archive@www.apache.org Delivered-To: apmail-accumulo-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9FE1318140 for ; Fri, 26 Feb 2016 18:15:12 +0000 (UTC) Received: (qmail 84253 invoked by uid 500); 26 Feb 2016 18:15:12 -0000 Delivered-To: apmail-accumulo-dev-archive@accumulo.apache.org Received: (qmail 84213 invoked by uid 500); 26 Feb 2016 18:15:12 -0000 Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list dev@accumulo.apache.org Received: (qmail 84196 invoked by uid 99); 26 Feb 2016 18:15:11 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Feb 2016 18:15:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 908DC1A023F for ; Fri, 26 Feb 2016 18:15:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.28 X-Spam-Level: * X-Spam-Status: No, score=1.28 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=deenlo-com.20150623.gappssmtp.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id UzeSFN4I29Q3 for ; Fri, 26 Feb 2016 18:15:10 +0000 (UTC) Received: from mail-ob0-f180.google.com (mail-ob0-f180.google.com [209.85.214.180]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id B92435F3FE for ; Fri, 26 Feb 2016 18:15:09 +0000 (UTC) Received: by mail-ob0-f180.google.com with SMTP id ts10so85338952obc.1 for ; Fri, 26 Feb 2016 10:15:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=deenlo-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=xCZsbxtGwectxf/hmrGfLyoCAOD4R2WUdLUlkGCeuQg=; b=R50PpmUrcUD1y/mVggw/DHlsCP9wP2H71W3V4YRGis7EA3srm8LYuTgavPltYzPFmV ehDkNomHfbqP3kqwgK6rHZlSAE8lgU+quWlnEoecLWSRbWGVS7f0HUifn55YPc0Id963 tjlpyDp+8sBUw/zTlRVEMxdAHiBShmylnwSFqo0AXyudQOOMAtTcNBPufmfGbVFqIxh4 /7h8BFoPsKhGlDrEy3DJbqrVSunAvFrEmxQh8mogRR8Z+uPAvAYxNy2ZUXf7R1D0EHZx QpeVPspeOISemKW75Ch2JUM8G//BSVilLHTCuxRMOBBL7N/WpUkK14sTrc883Iwa1OpJ zG7w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=xCZsbxtGwectxf/hmrGfLyoCAOD4R2WUdLUlkGCeuQg=; b=Uc92mCrA0F615g4BTKjehtwgzuemnPczGEkqnunNi+zXpvXI3VIeM0gcmo2F8nUiz9 RVsTSOALdKmIY7bpsrf4OJVctM9nsn60ccGWVklRjNzv0+PSb/0bFbzqZC44ndNYNCY7 qiwbNYszLHJsBHCTpzjqr8NolBlyTel3l84IWAvFgI65tTPBzVUHealCpDitTJ6WFOXf 07teIFZkwvB5TPud/8VDGlYIIIi9197/FrmXXp/NfQJxH/fnGRozuLyAAQFFCj2XtT1O /jtvO22Syk6xGLmEXoCJjpZL1tqfoiatvANE4IXuK5pBhbscaQLfX3e6RykpVi6PT2l7 PMxQ== X-Gm-Message-State: AD7BkJJt9MoqNXd5SE2QAtKcbHlSezmikTjyDw6SRVuLAKUF++cInqEUwn1s1goIIwbcQ1+aB2CBDttCd8uw9A== MIME-Version: 1.0 X-Received: by 10.60.142.170 with SMTP id rx10mr2200981oeb.37.1456510508984; Fri, 26 Feb 2016 10:15:08 -0800 (PST) Received: by 10.202.216.6 with HTTP; Fri, 26 Feb 2016 10:15:08 -0800 (PST) In-Reply-To: <56D083A1.3030608@gmail.com> References: <1456502319439-16202.post@n5.nabble.com> <56D083A1.3030608@gmail.com> Date: Fri, 26 Feb 2016 13:15:08 -0500 Message-ID: Subject: Re: cached connector From: Keith Turner To: Accumulo Dev List Content-Type: multipart/alternative; boundary=047d7b163515800694052cb047d2 --047d7b163515800694052cb047d2 Content-Type: text/plain; charset=UTF-8 On Fri, Feb 26, 2016 at 11:56 AM, Josh Elser wrote: > z11373 wrote: > >> My questions: >> 1. Since I haven't killed that service instance yet, is it possible to >> debug >> and find out the culprit? 100x slower is too much. Is that expected? What >> could be causing the slowness? >> > > No, definitely not expected. > > 2. This makes me think caching Accumulo connector may not be a good idea. >> Current implementation is the cache got refreshed if there's exception. >> Slow >> read won't trigger exception, so it stays in the cache. Is it recommended >> to >> not caching the Accumulo connector? >> > > I don't think we have the means to tell you what went wrong, but perhaps > we can help you find some clues. The Connector has some internal > synchronization, but I would not have thought caching a Connector would > have such negative impact -- sounds like a bug. > > * Try attaching a profiler to your service (e.g. Java Mission Control, > YourKit). These can help you connect to your running service and figure out > what is taking a long time. > * You can also go the "low-tech" route and take a few stackdumps (e.g. > `kill -3 ` or `jstack`) on your service to see get an idea of where it > is spending time. > * Take a heap dump of the service (e.g. `jmap`). Perhaps there is a lot of > garbage sitting on the heap not being collected or there's a memory leak. > There is also jstat, it can help you determine if the process is spending a lot of time on GC. --047d7b163515800694052cb047d2--