Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CCE2817B60 for ; Mon, 27 Apr 2015 17:28:39 +0000 (UTC) Received: (qmail 91624 invoked by uid 500); 27 Apr 2015 17:28:39 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 91575 invoked by uid 500); 27 Apr 2015 17:28:39 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 91565 invoked by uid 99); 27 Apr 2015 17:28:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Apr 2015 17:28:39 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: message received from 54.76.25.247 which is an MX secondary for user@accumulo.apache.org) Received: from [54.76.25.247] (HELO mx1-eu-west.apache.org) (54.76.25.247) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Apr 2015 17:28:13 +0000 Received: from mail-oi0-f51.google.com (mail-oi0-f51.google.com [209.85.218.51]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 5430D2314E for ; Mon, 27 Apr 2015 17:28:12 +0000 (UTC) Received: by oiko83 with SMTP id o83so95279546oik.1 for ; Mon, 27 Apr 2015 10:28:11 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:content-type; bh=dmDSugAafvSgKOLXNQTxA2h0CRynD1y4TxEbmruLM9w=; b=jyp9YEMe/xTFPskG6BXY+ANwLwlzSkRcHqYYssjkHwRZ7ru6+htHjpYWeLy1HXA/4b RKFaC7et7Mj1hx0w0VDsxjYdobTeG656M8oiQFptFlZ6tkqHEQuidxRoeA84fa4RUCHp d5G/3KpmgC+bcgIrU658cERrK5a9Vjtiz4dnlZ3Te5tP0kAZokUc3pGg96nWCwIUqZhe SjE94ot0zRNYhhTZvu5kc687Q9cBi1o++4qys9Cy9J1H7qSewmrqncR2PPKLOxtXFATh X2iF4TAWsnZXH8XjgjYTeKpxJr0THPSG15KVMXH2mMLg/TlxBbQY5sRgX0gGvyZZvDub US8w== X-Gm-Message-State: ALoCoQlucROZRyYAUfsjHRpRgkjyNAiBXKYSLPQZAwsEnHJ25maPVjpyQlnQ3t67DXVHsvcDHvso X-Received: by 10.182.56.161 with SMTP id b1mr10996868obq.22.1430155691262; Mon, 27 Apr 2015 10:28:11 -0700 (PDT) MIME-Version: 1.0 Sender: mdrob@cloudera.com Received: by 10.60.27.67 with HTTP; Mon, 27 Apr 2015 10:27:51 -0700 (PDT) In-Reply-To: References: From: Mike Drob Date: Mon, 27 Apr 2015 12:27:51 -0500 X-Google-Sender-Auth: lJwySvdqixL1Lrv3VzDjh2KDlGI Message-ID: Subject: Re: Approach to hold the output of an iterator in memory to do further operations To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=001a11c2d760f39ea50514b81132 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2d760f39ea50514b81132 Content-Type: text/plain; charset=UTF-8 Check out the MinCombiner https://github.com/apache/accumulo/blob/master/core/src/main/java/org/apache/accumulo/core/iterators/user/MinCombiner.java On Mon, Apr 27, 2015 at 12:19 PM, vaibhav thapliyal < vaibhav.thapliyal.91@gmail.com> wrote: > Hello everyone. > > I am trying to carry out max and min kind of operations using accumulo. > > But since the Accumulo iterators only operate on the entries that are > lovally hosted I get the local max and local min of the instead of a global > max and min. > > To get this global max and min, I have to calculate this client side. I > want to ask if there is some way to store this local max and min in memory > using iterator. So that a global max and min can be calculated server side > only. > > I tried to this by writing the result in another table and using another > iterator to return me the global max and min. > > I want to ask if there if a way to store this in memory so as to avoid > writing it to a table? > > Thanks > Vaibhav > --001a11c2d760f39ea50514b81132 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

On Mon, Apr 27, 2015 at 12:19 PM, vaibhav thapliyal &= lt;vaib= hav.thapliyal.91@gmail.com> wrote:

Hello everyone.

I am trying to carry out max and min kind of operations usin= g accumulo.

But since the Accumulo iterators only operate on the entries= that are lovally hosted I get the local max and local min of the instead o= f a global max and min.

To get this global max and min, I have to calculate this cli= ent side.=C2=A0 I want to ask if there is some way to store this local max = and min in memory using iterator. So that a global max and min can be calcu= lated server side only.

I tried to this by writing the result in another table and u= sing another iterator to return me the global max and min.

I want to ask if there if a way to store this in memory so a= s to avoid writing it to a table?

Thanks
Vaibhav


--001a11c2d760f39ea50514b81132--