Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 30323108D3 for ; Mon, 3 Feb 2014 13:31:38 +0000 (UTC) Received: (qmail 33827 invoked by uid 500); 3 Feb 2014 13:31:35 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 33597 invoked by uid 500); 3 Feb 2014 13:31:34 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 33586 invoked by uid 99); 3 Feb 2014 13:31:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Feb 2014 13:31:34 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of haosdent@gmail.com designates 209.85.214.169 as permitted sender) Received: from [209.85.214.169] (HELO mail-ob0-f169.google.com) (209.85.214.169) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Feb 2014 13:31:30 +0000 Received: by mail-ob0-f169.google.com with SMTP id wo20so7800937obc.14 for ; Mon, 03 Feb 2014 05:31:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Dkt50YihbmoaR68LIlqdxFFY7sWAx5sdLVVHbdF3JM8=; b=Jqu2sju87O/reVIxYaHPnKIzxRY0iq/pBsqfIsNI+y8wvdfIPjDqxpkKgLM9EAD6NG CNvhRCPLeVATCAJuqpEcsI90/t+dL964LJlDHhv+2icaLkk7deiwTQWFqAQ4nyPicf/Y IHisbkU/Yl4ltJY73XA8FYE6c9vM12qfdQ9tRABydsE4wIDBYdJEZw8OzYsxTHucYvBT 4jqGPY+MwLwObiBVmOXdvqbELM7tP/EUUDZ45y7Ia2rLp7z34vDpoBqas80kw5jzITuw 9EGT8ZZQdUJbj2i2nos34OeGPlmR8uy0bVVjhBh0/MaA2EoP0N6AbxOJrCwFtS02GMjF XaYw== MIME-Version: 1.0 X-Received: by 10.182.142.5 with SMTP id rs5mr6261497obb.39.1391434269414; Mon, 03 Feb 2014 05:31:09 -0800 (PST) Received: by 10.182.60.166 with HTTP; Mon, 3 Feb 2014 05:31:09 -0800 (PST) In-Reply-To: <710CC9F6-B217-4C50-84B9-B25B278CF61B@digitalenvoy.net> References: <710CC9F6-B217-4C50-84B9-B25B278CF61B@digitalenvoy.net> Date: Mon, 3 Feb 2014 21:31:09 +0800 Message-ID: Subject: Re: generate bulk load files from reducer From: haosdent To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a11c2d3b65b602304f18089b4 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2d3b65b602304f18089b4 Content-Type: text/plain; charset=ISO-8859-1 use HFileOutputFormat.getRecordWriter On Mon, Feb 3, 2014 at 9:15 PM, Brian Jeltema < brian.jeltema@digitalenvoy.net> wrote: > I have implemented a map/reduce job that generates HBase bulk files using > HFileOutputFormat. > I currently run a separate job step do generate those files in the mapper. > It would be > more efficient if I could generate those files in the reducer of the > previous job step, but I > don't see a supported way to do that. Can this be done? > > Brian -- Best Regards, Haosdent Huang --001a11c2d3b65b602304f18089b4--