Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of saint.ack@gmail.com designates
 209.85.216.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type;
        b=wLvcaytCjjfojAFArIcbsSOwf7B3aRO4sCD81SzPO5GtFz3bIgkvb4YCTlkTaMaIZo
         /V28+XFlubqgnLrVDdcisXXbr66xzV4P61/M2lDA8UP0mV6gWS4mQnwyxwI+tq+tehp8
         y8k968YCMSg7MmcGStXe8tKxsExxUw82e0I0k=
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: <BANLkTi=5uZvEi6gwcmvV7RyxLhpT2rR3nA@mail.gmail.com>
References: <BANLkTi=5uZvEi6gwcmvV7RyxLhpT2rR3nA@mail.gmail.com>
Date: Tue, 24 May 2011 21:04:01 -0700
Message-ID: <BANLkTi=3AsorV7euusL3dYVOH0J=gsvCwQ@mail.gmail.com>
Subject: Re: One map task to two HFiles
From: Stack <stack@duboce.net>
To: user@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1

On Tue, May 24, 2011 at 2:26 PM, Jon Stewart
<jon@lightboxtechnologies.com> wrote:
> I have enough control over the keys for the primary table that the map
> task could write rows to the primary table in order, making it
> map-side only (assuming one HFile per task). The map task could then
> emit KeyValue objects for the secondary hash table and let
> HFileOutpuFormat/KeyValueSortReducer do its thing.
>
> The question is, how do I write an HFile from a map task?
> HFile.Writer? What are the gotchas?
>

Nothing fancier than open on map task init, append, append, append,
inside in the map, and then be sure to close it in the map close.
Study HFileOutputFormat I'd say.

St.Ack