Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6B69EEEE8 for ; Sat, 26 Jan 2013 18:40:46 +0000 (UTC) Received: (qmail 44806 invoked by uid 500); 26 Jan 2013 18:40:44 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 44755 invoked by uid 500); 26 Jan 2013 18:40:44 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 44747 invoked by uid 99); 26 Jan 2013 18:40:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 Jan 2013 18:40:44 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of amits@infolinks.com designates 207.126.144.129 as permitted sender) Received: from [207.126.144.129] (HELO eu1sys200aog110.obsmtp.com) (207.126.144.129) by apache.org (qpsmtpd/0.29) with SMTP; Sat, 26 Jan 2013 18:40:36 +0000 Received: from mail-la0-f71.google.com ([209.85.215.71]) (using TLSv1) by eu1sys200aob110.postini.com ([207.126.147.11]) with SMTP ID DSNKUQQjENOCaeJlQ8X7cjlCF4D/InkcnDOt@postini.com; Sat, 26 Jan 2013 18:40:16 UTC Received: by mail-la0-f71.google.com with SMTP id fr10so206152lab.6 for ; Sat, 26 Jan 2013 10:40:15 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:x-received:in-reply-to:references:date :message-id:subject:from:to:content-type:x-gm-message-state; bh=mJh0raUHYdbWiKi2ollViSY3v0KHb4FYCcyCN//AlhQ=; b=NwRHcFw1oFM2u38TuAuCCCQiXvC2z5ANer+MyV8RM+xMW1YBWnw2Tjh+PNFYm+C7FM 7BSNx2bypzkvpJ6sSwI5nn5jVWfTC6eMsPVfbasUsa63lW+Wr6m8cPbBh4+1vOZjFQf1 kBPmqO/84wa3lJmMPSrjx9Vbe3DRfLVRYDV6CDwFla7Gk3UHKBvarbIrSMZpLkb2eVxB v4DCtYE0a7NaWTIQ+G4zllG/Q6kkhH9+07eEMbZbwQThdlfFNq7vaUGwFAW/Yl6WBqee zlVppVBMJnOoZPQQy1za9Kyqr7mVcjePZFu9mNUhX9/6hn1FsVTrvHZPi12Xqgtuv1SX FkdA== X-Received: by 10.112.17.194 with SMTP id q2mr3661199lbd.7.1359225615492; Sat, 26 Jan 2013 10:40:15 -0800 (PST) MIME-Version: 1.0 X-Received: by 10.112.17.194 with SMTP id q2mr3661196lbd.7.1359225615152; Sat, 26 Jan 2013 10:40:15 -0800 (PST) Received: by 10.114.21.4 with HTTP; Sat, 26 Jan 2013 10:40:15 -0800 (PST) Received: by 10.114.21.4 with HTTP; Sat, 26 Jan 2013 10:40:15 -0800 (PST) In-Reply-To: <9E20080B-CEE7-4F73-806C-FBFE8CB6BED1@gmail.com> References: <1358994226.69218.YahooMailNeo@web140602.mail.bf1.yahoo.com> <3490608131839349829@unknownmsgid> <-3611561647206253620@unknownmsgid> <9E20080B-CEE7-4F73-806C-FBFE8CB6BED1@gmail.com> Date: Sat, 26 Jan 2013 20:40:15 +0200 Message-ID: Subject: Re: HBASE-7114 Increment does not extend Mutation but probably should From: Amit Sela To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=bcaec554d84cf5f93104d4355f55 X-Gm-Message-State: ALoCoQnKwrHGzxSTaHJc16opWJxtAibhJiMag1kt/7xJXPuLHrnL5B/3vbOFFBaefcztdzgmOapimYfi7n9cwlBgG1bysyqxa1N0L6A9vA0X5wdo4n2qzy8ZW2W/CD4ARBZaJsh48HYUotrX1ilC/SJ9l86RKalOz3pvadOHy69fi8XTVcNtbXs= X-Virus-Checked: Checked by ClamAV on apache.org --bcaec554d84cf5f93104d4355f55 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Sounds right ;) I'll try that, thanks ! On Jan 26, 2013 8:30 PM, "Asaf Mesika" wrote: > Yep. > I think it would be faster it you will change the Increment object in the > preIncrement object and add the allCountries column to it. > > When you do it in the PostIncrement method, you will do another Increment > call, thus another :rowLock, write to WAL, etc. > > You can benchmark it easily. > > On 26 =D7=91=D7=99=D7=A0=D7=95 2013, at 20:01, Amit Sela wrote: > > > The increment has many columns: impressions_country, clicks_country, et= c. > > And these counters count events in our system. Since we don't have an > "all > > countries" event, I thought it would be best to do that with a > > RegionObserver (each row has it's own counters so no risk in going > outside > > the region right ?) . > > On Jan 26, 2013 7:15 PM, "Asaf Mesika" wrote: > > > >> Why not have the Increment object have two columns: one for the countr= y > and > >> one for the allCountries ? > >> > >> Sent from my iPhone > >> > >> On 26 =D7=91=D7=99=D7=A0=D7=95 2013, at 18:54, Infolinks wrote: > >> > >> Yes, of course. It's an all counter for the specific keyword. > >> > >> =D7=91-26 =D7=91=D7=99=D7=A0=D7=95 2013, =D7=91=D7=A9=D7=A2=D7=94 18:4= 0, Asaf Mesika =D7=9B=D7=AA=D7=91/=D7=94: > >> > >> The all counters is on the same row? > >> > >> > >> By the way, did you guys handle the hbase bug that when an increment i= s > >> > >> sent to region server and fails it still does it but throws an > exception to > >> > >> the client which causes it to do that increment again? > >> > >> > >> > >> Sent from my iPhone > >> > >> > >> On 26 =D7=91=D7=99=D7=A0=D7=95 2013, at 17:32, Amit Sela wrote: > >> > >> > >> Well, I increment counters where the row key is a keyword and the > qualifier > >> > >> is a country code, and in the post increment region observer I > increment an > >> > >> "all countries" aggregative counter. These counters are divided to > families > >> > >> such as daily, weekly, hourly etc. > >> > >> So I get the family map to know which aggregative counter should I > >> > >> increment, then I piggyback onto the Result the "all countries" curren= t > >> > >> count. > >> > >> On Jan 26, 2013 2:39 AM, "Ted Yu" wrote: > >> > >> > >> Amit: > >> > >> > >> Can you tell us what operation you perform on the returned family map = ? > >> > >> > >> > >> Thanks > >> > >> > >> > >> On Thu, Jan 24, 2013 at 3:37 AM, Amit Sela wrote= : > >> > >> > >> > >> I'm using Increment.getFamilyMap in a postIncrement Observer. > >> > >> > >> I'm running with HBase 0.94.2. > >> > >> > >> > >> Amit. > >> > >> > >> > >> On Thu, Jan 24, 2013 at 4:23 AM, lars hofhansl > wrote: > >> > >> > >> > >> The reason was that Increment was serialized differently (compared to > >> > >> > >> all > >> > >> > >> other mutations). > >> > >> > >> In trunk that is no longer an issue, since the serialization logic is > >> > >> > >> no > >> > >> > >> longer part of the object to be serialized. > >> > >> > >> > >> > >> -- Lars > >> > >> > >> > >> > >> > >> ________________________________ > >> > >> > >> From: Ted Yu > >> > >> > >> To: dev@hbase.apache.org; user@hbase.apache.org > >> > >> > >> Sent: Wednesday, January 23, 2013 10:25 AM > >> > >> > >> Subject: HBASE-7114 Increment does not extend Mutation but probably > >> > >> > >> should > >> > >> > >> > >> Hi, > >> > >> > >> I want to get opinion on whether we should proceed with HBASE-7114 > >> > >> > >> 'Increment does not extend Mutation but probably should' in trunk. > >> > >> > >> > >> Is anyone using Increment.setWriteToWAL or Increment.getFamilyMap ? > >> > >> > >> For Increment.setWriteToWAL, are you using the Increment returned ? > >> > >> > >> > >> Your feedback would be appreciated. > >> > > --bcaec554d84cf5f93104d4355f55--