Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 54D3117B0D for ; Fri, 8 May 2015 16:27:58 +0000 (UTC) Received: (qmail 54531 invoked by uid 500); 8 May 2015 16:27:56 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 54465 invoked by uid 500); 8 May 2015 16:27:56 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 54452 invoked by uid 99); 8 May 2015 16:27:56 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 May 2015 16:27:56 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id A0734C291B for ; Fri, 8 May 2015 16:27:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.551 X-Spam-Level: X-Spam-Status: No, score=-0.551 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Yx0btXrhv3p6 for ; Fri, 8 May 2015 16:27:39 +0000 (UTC) Received: from mail-pd0-f181.google.com (mail-pd0-f181.google.com [209.85.192.181]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 87599453EF for ; Fri, 8 May 2015 16:26:38 +0000 (UTC) Received: by pdbqa5 with SMTP id qa5so87581010pdb.1 for ; Fri, 08 May 2015 09:26:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=zdD7xLJwIr7nHzUF09sAbzPuOFucjed+kpdS60mgLxo=; b=OXLAdxPbnyRplDgmEkeQ7F+R+YHZmTFjQ0uAIbexGcRsFhwNJve/RnfXTbVMDKYgx2 EFyAD5sDNgCi1OOLLUR2PX8iotm/+Kl0T7g+w0RiM19/p7SOUlmM4+rxyY9KKXg3YZ2k JWFrjbarUlLPy60o7+83WAJvsXnP2gHuytG+vLymqnVXU/kbsr+bzVLXZEWVaHZURcZ+ C3meSUfGG+oNaEow6RB94HtXkE2cWHu5/j5amOjWaY8FeInaP9Rk3eu2G4ClovY3NXu1 LqRr0KilqeqGRzaX4AfSJDT6cYyiOifBywZr+f/NHmdHBUqKdDYcR2ppB7RRBGrbucV9 rc7Q== X-Received: by 10.70.128.200 with SMTP id nq8mr7763024pdb.167.1431102332962; Fri, 08 May 2015 09:25:32 -0700 (PDT) Received: from ?IPv6:2620:149:4:1204:7dc1:ed5f:6b8d:4ba0? ([2620:149:4:1204:7dc1:ed5f:6b8d:4ba0]) by mx.google.com with ESMTPSA id en2sm5676704pab.14.2015.05.08.09.25.31 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 08 May 2015 09:25:32 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2099\)) Subject: Re: MapReduce on Sanpshots From: Rahul Malviya In-Reply-To: Date: Fri, 8 May 2015 09:25:30 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <3804B5A9-998E-4BAE-BC8D-1B31EDF4F065@gmail.com> References: To: user@hbase.apache.org X-Mailer: Apple Mail (2.2099) Thanks Ted. Seems to answer my question. Rahul > On May 8, 2015, at 9:04 AM, Ted Yu wrote: >=20 > Please see Release Note of HBASE-8369 >=20 > Cheers >=20 > On Fri, May 8, 2015 at 8:16 AM, Rahul Malviya = > wrote: >=20 >> Hi All, >>=20 >> I have been MapReduce on HBase for a while now and this has been = really >> successful for me. But I have some MRs jobs in my pipeline which scan = every >> row on hbase. So I was wondering I move this MR job to run on = snapshot that >> will reduce the load on RSs and HBase direct operations mostly get = wont be >> affected by my long running full scan MR job. >>=20 >> Let me know if my understanding is correct and what are possible = drawbacks >> of doing this. I am mostly worried that my job will start talking = longer >> time as compared to MR directly in HBase table. Please provide some = details >> on this. >>=20 >> Thanks, >> Rahul