hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sai Pavan Gadde <id4gpa...@gmail.com>
Subject Re: HBase- Hive Integration
Date Mon, 17 Mar 2014 06:23:01 GMT
Hi all,

Thank you for replies,

Looking for more suggestions

-- 
*THANKS & REGARDS,*
G.SAI PAVAN,
CCDH4 CERTIFIED,
Ph: 8121914494,
*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
HYDERABAD.



On Fri, Mar 14, 2014 at 11:59 PM, Nick Dimiduk <ndimiduk@gmail.com> wrote:

> hbase-dev to bcc; adding hive-user. this is a question for the user lists,
> and more for Hive's than HBase, as HBaseStorageHandler is code in Hive
> project, not HBase.
>
> Hi Sai,
>
> You are embarking into a brave world. Because your aim is the interop
> across these different Apache projects, I highly recommend using a vendor's
> distribution. The reason being that the vendor has done the work of
> certifying interoperability for you, so you won't be left finding bugs in
> the edges that aren't well tested in the communities. Notice in the blog
> post referenced, I was using a distribution and even then I've found
> interop issues.
>
> Hive 0.11 will require you manually specify the HBase jars. Please don't
> copy them around, instead use environment variables. You can follow along
> with my blog post and set HADOOP_CLASSPATH and HIVE_AUX_JARS_PATH
> appropriately. You're using HBase 0.96.1, which includes HBASE-8438, so you
> can use `hbase mapredcp` instead of itemizing jars manually. This
> requirement (hopefully) goes away entirely in Hive 0.13 with HIVE-2379
> and HIVE-2055.
>
> Finally, are you using Hive on the CLI or through a web tool (Hue?). The
> details change slightly based on all these... details.
>
> Good luck. Keep asking questions. Please file bugs.
>
> Thanks,
> Nick
>
>
> On Thu, Mar 13, 2014 at 10:56 PM, Sai Pavan Gadde <id4gpavan@gmail.com
> >wrote:
>
> > Hi,
> >
> > Here is my document in an attached file. It contains my flow of
> hive-hbase
> > integration.
> > 1. I created a table in mysql and imported into hbase,
> > 2. I copied a hive-handler.jar, guva.jar and zookeeper.jar file in
> > Hadoop-2.2.0/share/mapred/lib folder
> > 3. copied required hive(0.11.0) jars to hbase(0.96.1.1-hadoop2) && hbase
> > jars to hive
> > 4. Trying to create a table in hive with hbase properties but gets error
> as
> >
> >
> > *FAILED: Error in metadata: MetaException(message:java.io.IOException:
> > java.lang.reflect.InvocationTargetException*
> >
> >
> > I think so hbase-0.96.1.1-hadoop2.jar file is not present in  HBase
> > directory.
> >
> > So, Suggest for further step to proceed.
> >
> >
> > On Thu, Mar 13, 2014 at 7:12 PM, kulkarni.swarnim@gmail.com <
> > kulkarni.swarnim@gmail.com> wrote:
> >
> >> Hi Sai,
> >>
> >> If you can show us what specific exception you are seeing, we would be
> >> able
> >> to help you out in a better way.
> >>
> >> Thanks,
> >>
> >>
> >> On Thu, Mar 13, 2014 at 7:44 AM, Sai Pavan Gadde <id4gpavan@gmail.com
> >> >wrote:
> >>
> >> > Hi,
> >> > Thanks for reply... but
> >> >
> >> > I worked with hadoop-1.2.1 which is fine working, but need with real
> >> > requirement is Hadoop-2.2.0 i.e, YARN
> >> >
> >> > Please show the way to get solve with apache products
> >> >
> >> > I Installed HBase-0.96.1.1-hadoop2 on top of hadoop-2.2.0, installed
> >> > hive-0.11.0 too,
> >> >
> >> > Copied hive-hbase-handler-0.11.0 to hadoop-2.2.0, guva.jar,
> >> zookeeper.jar
> >> >
> >> > I created hbase-0.96.1.1-hadoop2.jar(which is absent in version) and
> >> worked
> >> > but not getting connected with hive. I suppose to work with
> >> hadoop-0.94.x
> >> > but the version is not compatible with hadoop-2.2.0
> >> >
> >> > I tried in all the way, not found the solution, please suggest me
> >> >
> >> >
> >> >
> >> >
> >> > On Thu, Mar 13, 2014 at 4:20 PM, Joshi, Rekha <Rekha_Joshi@intuit.com
> >> > >wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > > We have successfully created external hive table pointing to hbase
> >> table
> >> > > with settings for hive, zookeeper, HBase security tokens.
> >> > >
> >> > > If it is a jar problem, then mostly the env is not set
> correctly.Hive
> >> > > should be able to recognize HBaseStorageHandler.
> >> > >
> >> > > Thanks
> >> > > Rekha
> >> > >
> >> > >
> http://hortonworks.com/blog/using-hive-to-interact-with-hbase-part-2/
> >> > >
> >> > >
> >> > >
> >> > > On 3/13/14, 10:15 AM, "Sai Pavan Gadde" <id4gpavan@gmail.com>
> wrote:
> >> > >
> >> > > >Hi,
> >> > > >
> >> > > >I am using hadoop-2.2.0 , HBASE-0.96.1.1-hadoop2 and hive-0.11.0
> >> version
> >> > > >for a project. I got a requirement such that i have to integrate
> >> hbase
> >> > to
> >> > > >hive , so that table reflection should happens.
> >> > > >
> >> > > >while  i am doing this, i got error like TARGET INNOVOCATION
> >> EXCEPTION.
> >> > > >This is because jar file target missing. please suggest me to
> >> overcome
> >> > the
> >> > > >problem
> >> > > >
> >> > > >--
> >> > > >*THANKS & REGARDS,*
> >> > > >G.SAI PAVAN,
> >> > > >CCDH4 CERTIFIED,
> >> > > >Ph: 8121914494,
> >> > > >*www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >> > > >linkedin profile <
> >> > http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >> > > >HYDERABAD.
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > *THANKS & REGARDS,*
> >> > G.SAI PAVAN,
> >> > CCDH4 CERTIFIED,
> >> > Ph: 8121914494,
> >> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> >> > linkedin profile <
> >> http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/>
> >> > HYDERABAD.
> >> >
> >>
> >>
> >>
> >> --
> >> Swarnim
> >>
> >
> >
> >
> > --
> > *THANKS & REGARDS,*
> > G.SAI PAVAN,
> > CCDH4 CERTIFIED,
> > Ph: 8121914494,
> > *www.bigdatatrendz.com <http://www.bigdatatrendz.com>*
> > linkedin profile <http://in.linkedin.com/pub/gadde-sai-pavan/38/44b/453/
> >
> > HYDERABAD.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message