hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yi Liang <easyliang...@gmail.com>
Subject Re: Noob question about Hadoop job that writes output to HBase
Date Fri, 21 Apr 2017 17:51:27 GMT
>From your setup in the tutorial [1], I saw it set HBASE_MANAGES_ZK=true and
zookeeper.clientport=2222, but in your mapreduce code you set it as 2181,
maybe that is the reason, it got stuck.

On Fri, Apr 21, 2017 at 9:12 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> Evelina:
> Was hbase-site.xml on the classpath for your hadoop job ?
>
> On Fri, Apr 21, 2017 at 8:45 AM, Josh Elser <elserj@apache.org> wrote:
>
> > Use jstack on the AM or Mapper to figure out what it's stuck doing.
> >
> > FWIW, `conf.set("hbase.zookeeper.quorum", "localhost");` will not work
> if
> > you have more than one node.
> >
> >
> > evelina dumitrescu wrote:
> >
> >> The Hadoop version that I use is 2.7.1 and the Hbase version is 1.2.5.
> >> I can do any operation from the HBase shell.
> >>
> >>
> >> On Fri, Apr 21, 2017 at 8:00 AM, evelina dumitrescu<
> >> evelina.a.dumitrescu@gmail.com>  wrote:
> >>
> >> Hi,
> >>>
> >>> I am new to Hadoop and Hbase.
> >>> I was trying to make a small proof-of-concept Hadoop map reduce job
> that
> >>> reads the data from HDFS and stores the output in Hbase.
> >>> I did the setup as presented in this tutorial [1].
> >>> Here is the pseudocode from the map reduce code [2].
> >>> The problem is that I am unable to contact Hbase from the Hadoop job
> and
> >>> the job gets stuck.
> >>> Here are the logs from syslog [3], stderr [4] and console [5].
> >>> How should I correctly setup HbaseConfiguration ?
> >>> I couldn't find any example online that worked and it's hard for a
> >>> beginner to debug the issue.
> >>> Any help would be appreciated.
> >>>
> >>> Thank you,
> >>> Evelina
> >>>
> >>> [1]
> >>> http://www.bogotobogo.com/Hadoop/BigData_hadoop_HBase_
> >>> Pseudo_Distributed.php
> >>> [2]
> >>> https://pastebin.com/hUDAMMes
> >>> [3]
> >>> https://pastebin.com/XxmWAUTf
> >>> [4]
> >>> https://pastebin.com/fYUYw4Cv
> >>> [5]
> >>> https://pastebin.com/YJ1hERDe
> >>>
> >>>
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message