Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6967617952 for ; Mon, 11 May 2015 17:12:35 +0000 (UTC) Received: (qmail 53891 invoked by uid 500); 11 May 2015 17:12:33 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 53815 invoked by uid 500); 11 May 2015 17:12:33 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 53804 invoked by uid 99); 11 May 2015 17:12:33 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 May 2015 17:12:33 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 92DE2C3F62 for ; Mon, 11 May 2015 17:12:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.981 X-Spam-Level: *** X-Spam-Status: No, score=3.981 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id uupSWIe-aZ-U for ; Mon, 11 May 2015 17:12:24 +0000 (UTC) Received: from mail-wg0-f43.google.com (mail-wg0-f43.google.com [74.125.82.43]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 38A3420696 for ; Mon, 11 May 2015 17:12:24 +0000 (UTC) Received: by wgbhc8 with SMTP id hc8so34778201wgb.2 for ; Mon, 11 May 2015 10:12:22 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=RYdIjbkWM4H9C4W+4viFmM22VwGnMQ4o4/PHaj5RrWI=; b=AXr489WONEtbqv/VcTpcNLKUbduDmEygBh36qch7WcC7IhgxNRtZAWB76PWk9+6QJH QS7ucPV8c3jwbYdO4pWhuK7Iap183bKFj+WpVdoe5In2bcYz6m6B2f4038bnkZrzKS86 FAx6VnvKbwHsW7+3YjOefO7uidxH38/mGHUxeyvH9SAykme4kGpw5JbOCUNfeVKU1jgD gOgaj7iOk0DYkVj8mBdoXqs7kSphjhcqQGVJJfMG3Rgr9zIyFpsAsF2QYfBFgnU2fJGS 4IwKOom+PhCNqGoLZyb9DsB/0AVlqTV211+KfQmR601qX/77w23WED2BwjkRtCFxGD+s TdrA== X-Gm-Message-State: ALoCoQlW4Re9fLp8Qktuh37D40oFsa9moFEPJic9wMgqTsL/jvFwFCD/yJQeH9tNbnG2iF943+Vg X-Received: by 10.194.193.66 with SMTP id hm2mr21692084wjc.111.1431364342750; Mon, 11 May 2015 10:12:22 -0700 (PDT) Received: from mail-wg0-f54.google.com (mail-wg0-f54.google.com. [74.125.82.54]) by mx.google.com with ESMTPSA id xb3sm20612343wjc.38.2015.05.11.10.12.21 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 11 May 2015 10:12:21 -0700 (PDT) Received: by wgbhc8 with SMTP id hc8so34777287wgb.2 for ; Mon, 11 May 2015 10:12:20 -0700 (PDT) X-Received: by 10.194.81.169 with SMTP id b9mr21714947wjy.126.1431364340915; Mon, 11 May 2015 10:12:20 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.14.85 with HTTP; Mon, 11 May 2015 10:12:00 -0700 (PDT) In-Reply-To: References: <2ce0a136652442f9ad91082ca7bc1f4a@aplex05.dom1.jhuapl.edu> From: Mike Axiak Date: Mon, 11 May 2015 19:12:00 +0200 Message-ID: Subject: Re: Mapping Over Cells To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=047d7bea3afe15a8560515d17bb5 --047d7bea3afe15a8560515d17bb5 Content-Type: text/plain; charset=UTF-8 Hi Ryan, You can call setBatch() on the scan to get partial rows returned in your map task. (The Result object won't be guaranteed to have all cells for a given row.) On Mon, May 11, 2015 at 6:24 PM, Webb, Ryan L. wrote: > Looks like the duplicate made it through. > > Sorry about that! > > -----Original Message----- > From: Webb, Ryan L. [mailto:Ryan.Webb@jhuapl.edu] > Sent: Monday, May 11, 2015 11:15 AM > To: user@hbase.apache.org > Subject: Mapping Over Cells > > Hello, > > We have a table in HBase that has very large rows and it goes OOM when the > table mapper attempts to read the entire row into a result. > > We would like to be able to map over each Cell in the table as a solution > and it is what we are doing in the map anyway. > Is this possible? Like the default behavior for Accumulo? > > We looked at the settings on Scan and didn't really see anything and the > source code of Result looks like it wraps an array of cells so the data is > already loaded at that point. > We are using HBase .98.1 and Hadoop 2 APIs > > Thanks > Ryan Webb > --047d7bea3afe15a8560515d17bb5--