Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CADcMMgGuOVB12Kr-XnVaM8avEG2pvZ-dVERM63eYWF0LqPMjmA@mail.gmail.com>
References: <E6DC0283-349B-4361-9BC3-387760714080@gmail.com>
	<CADcMMgGuOVB12Kr-XnVaM8avEG2pvZ-dVERM63eYWF0LqPMjmA@mail.gmail.com>
Date: Fri, 2 Oct 2015 15:46:53 -0400
Message-ID: 
 <CAMZ9ouNR+4TQXFpHwLVg40cuGsk=DEVJjgV1qjdE2bcJvRNfzg@mail.gmail.com>
Subject: Re: Hadoop streaming with HBase as data sink
From: Pei Zhao <pei.zhao.cs@gmail.com>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=f46d043bdfd2e70a9a0521246c14

--f46d043bdfd2e70a9a0521246c14
Content-Type: text/plain; charset=UTF-8

Hi Stack,

In my case, I tried to use HBase Thrift API, but Thrift server sometimes
crashes during my MapReduce job, due to out of heap memory.

Do you have any suggestions on that please?

Thanks

On Fri, Oct 2, 2015 at 3:10 PM, Stack <stack@duboce.net> wrote:

> You can't do hadoop streaming into hbase. Maybe explore hbase REST
> interface and see if you can format puts that hbase REST can digest.
> St.Ack
>
> On Fri, Oct 2, 2015 at 12:00 PM, Pei Zhao <pei.zhao.cs@gmail.com> wrote:
>
> > Hi all,
> >
> > I am a graduate student do research in solar cell data management. My
> > project is using Hadoop/HBase. Recently we switch MapReduce to Python
> using
> > Hadoop streaming.
> >
> > My question is can I use Hadoop streaming, which outputs to stdout with a
> > specific format that HBase can pick it up and put them into tables?
> >
> > For instance,
> >
> > If I output lines of RowKey\t\Column\tValue , then HBase can know how to
> > put this into tables.
> >
> > Regards
> > Pei
>


-- 
*Pei (Asher) Zhao*
*Electrical Engineering and Computer Science*
*Case Western Reserve University*
*Cleveland, Ohio 44106*

*--The man who has made up his mind to win will never say impossible.*

--f46d043bdfd2e70a9a0521246c14--