Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <CAKNjhrcg7rUYV_4T4jnXYqB+_qgCHkn7E9v+NJAx_9zq0dZwXw@mail.gmail.com>
References: 
 <CAN1suNPPhPF=ZhBCaqmDfvJENo7-LhhRWVjwGpfohS15CyOvgQ@mail.gmail.com>
	<CAF1+Vs-mGgiLHR9DJQRey62cpJJwv76xUs7ga=+xXNsae9=rvg@mail.gmail.com>
	<CAN1suNML0XDz4S1iBUMBzmLbc-G-o4C-jdNhWCRve5HAv=NXOA@mail.gmail.com>
	<CAF1+Vs_-MAL7ak4GDn06-3ybfoqModtpAHpvCnoFViOERqf_CA@mail.gmail.com>
	<CAN1suNMQYZCJdUXMzYQq1N4_1dqeJ-dSKYMDn=xmb4gWA5XeQw@mail.gmail.com>
	<CAF1+Vs_Acs6De2dHcrJuL8czL6+UwUNDU-1rEczjB2rvpdCx5g@mail.gmail.com>
	<CAN1suNOd7w8Q5kh14Ff7-Gu8Cck04pqCDq8RfP93fXZ_P9iN5w@mail.gmail.com>
	<CALte62wkzjNYMXj4758fCDhgDebo-Tg3bPXYYJRp2J9rR5CWxQ@mail.gmail.com>
	<CAN1suNPi_5UvxdPkyqceLgYG6gqxeN-X_LrCw+t=oucMcYJ2_Q@mail.gmail.com>
	<CAF1+Vs-gEChuDXkSuO4bhxwQMOw1dym3mxvw2WMw8do9UpLOnw@mail.gmail.com>
	<CAF1+Vs_qDANNVbODcJsUsvs9LXaF8h20Atw6FNPHKx1eUDO+og@mail.gmail.com>
	<CAF1+Vs_mSQZx4yenqf1NwFc1igDJcHWcOnJ2dXvtRpe5fKyHTg@mail.gmail.com>
	<CALte62yqEWbK-UfB=G3N13A1upoZ9Vs=heqcsxk1v1OcPXP_6g@mail.gmail.com>
	<CAF1+Vs8qsv+RFYefGtJNrpeH=JpBv-_6eJKPu1-mTF=Bq4+0-w@mail.gmail.com>
	<CAF1+Vs_YfPPY5=ZHc3DTpL26P_uoeL+1nQLY7qYc6pWU47D7Yg@mail.gmail.com>
	<CAN1suNN7y-fT2ukOB=Q09+CqsJi2KSvxv8ZYuirU4qGAPzb6Ew@mail.gmail.com>
	<6BDC06FA-A136-44B1-88FA-26F99F857735@gmail.com>
	<CAN1suNNreN1Nc8OQDbQtYdVhPJGypbotcDeP0LVx1yY8pufAWg@mail.gmail.com>
	<CAF1+Vs_7SZu7P8LVP+=okCrRAyY6HieF76Dt7k3Fk==1DAZp6w@mail.gmail.com>
	<CAKNjhrcg7rUYV_4T4jnXYqB+_qgCHkn7E9v+NJAx_9zq0dZwXw@mail.gmail.com>
Date: Wed, 3 Oct 2012 18:26:38 +0200
Message-ID: 
 <CAN1suNN5iqbVHSzcz69D2VL=coyfvZkODuyU1icixCqV29AG8A@mail.gmail.com>
Subject: Re: BigDecimalColumnInterpreter
From: Julian Wissmann <julian.wissmann@sdace.de>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=047d7b6d8b285d8f2204cb2a1ad4

--047d7b6d8b285d8f2204cb2a1ad4
Content-Type: text/plain; charset=ISO-8859-1

Hi, thank you Anil. I realized I had put the jar only on the master and
expected stuff to work from there. I now deployed it on all the
regionservers and loaded AggregateImplementation on the regions. It works
now. Thank you!

2012/9/29 Robertis Tongbram <rtongbram@gmail.com>

> For pushing jars to the region servers , i have a small script.
>
> <code>
>
> #!/usr/bin/expect -f
>
>
> for {set i 1} {$i < 6} {incr i 1} {
>
>
>     spawn scp target/lib.jar root@region-$i:/opt/hbase/hbase-0.92.1/lib/
>     expect {
>         -re ".*es.*o.*" {
>             exp_send "yes\r"
>                 exp_continue
>         }
>         -re ".*sword.*" {
>             exp_send "p4sSw0rd\r"
>         }
>     }
>     interact
>
> }
>
> </code>
>
> I have my region servers as region-1, region-2 and so on, default
> installation is at /opt/hbase/hbase-0.92.1/
>  lib.jar is the final jar file that has the classes.
>
> I put this script where the pom file is ( i have a maven project).
>
>
>
>
> Hope this helps.
>
>
> Thanks,
> Robertis
>
>
>
> On Sat, Sep 29, 2012 at 8:35 AM, anil gupta <anilgupta84@gmail.com> wrote:
>
> > This ColumnInterpreter is required at the server side. You need to put
> the
> > jar into the classpath of regionservers. HBase picks up all the jar under
> > $hbase_home/lib folder. So you can put the jar containing the BDCI class
> in
> > this folder. Please make sure that in your client side you are
> referencing
> > the correct BDCI class(the full name of class at server side should match
> > with the ColumnInterpreter class you reference on client side). Once you
> > put the jar into lib folder then you will need to restart the cluster
> once
> > so that the regionserver will the load the jar containing BDCI.
> >
> > Basically you just need to put the utility class(which i sent a couple of
> > weeks ago) into a jar, copy the jar into lib folder, restart the cluster,
> > and then run the utility. It should work.
> >
> > Hope it's clear this time.
> >
> > Thanks,
> > Anil Gupta
> >
> > On Sat, Sep 29, 2012 at 8:03 AM, Julian Wissmann
> > <julian.wissmann@sdace.de>wrote:
> >
> > > Interesting. Did you put just the ColumnInterpreter into the jar?
> > >
> > > 2012/9/21 Anil Gupta <anilgupta84@gmail.com>
> > >
> > > > I was able to run it successfully once I copied the jar into lib
> > folders
> > > > of region server and hamster and restarted the cluster.
> > > > Did you copied the jar into lib folders of region servers and hmaster
> > and
> > > > restarted the cluster. If yes, can you share the logs of regionserver
> > > > hosting the region test table?
> > > >
> > > > Best Regards,
> > > > Anil
> > > >
> > > > On Sep 21, 2012, at 4:14 AM, Julian Wissmann <
> julian.wissmann@sdace.de
> > >
> > > > wrote:
> > > >
> > > > > Hi Anil,
> > > > >
> > > > > found some time to test it, today. Same error as you get, same
> error
> > as
> > > > > always ;-)
> > > > >
> > > > > Julian
> > > > >
> > > > > 2012/9/20 anil gupta <anilgupta84@gmail.com>
> > > > >
> > > > >> Hi Julian,
> > > > >>
> > > > >> I am curious to know whether you got the opportunity to test BDCI
> > > > utility i
> > > > >> sent last week along with some suggestions on using it? Did it run
> > > > >> successfully?
> > > > >>
> > > > >> I will try to have a look at your unit test over weekend.
> > > > >> Thanks,
> > > > >> Anil Gupta
> > > > >>
> > > > >> On Thu, Sep 20, 2012 at 10:29 AM, Julian Wissmann
> > > > >> <julian.wissmann@sdace.de>wrote:
> > > > >>
> > > > >>> Hi,
> > > > >>>
> > > > >>> as I've also mentioned in the JIRA Issue:
> > > > >>>
> > > > >>> I've written a Test, but have problems with Medium Tests
> requiring
> > > > >>> MiniDFSCluster:
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> -------------------------------------------------------------------------------
> > > > >>> Test set:
> org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> -------------------------------------------------------------------------------
> > > > >>> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> > 3.239
> > > > >>> sec <<< FAILURE!
> > > > >>> org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol Time
> > > elapsed:
> > > > >>> 0.001 sec <<< ERROR!
> > > > >>> java.lang.NullPointerException
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:422)
> > > > >>> at
> > > > org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:433)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:653)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:603)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:590)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol.setupBeforeClass(TestAggregateProtocol.java:77)
> > > > >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > > > >>> at java.lang.reflect.Method.invoke(Method.java:597)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:27)
> > > > >>> at
> > > > >>>
> > > > >>
> > > >
> > >
> >
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
> > > > >>> at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
> > > > >>> at org.junit.runners.Suite.runChild(Suite.java:128)
> > > > >>> at org.junit.runners.Suite.runChild(Suite.java:24)
> > > > >>> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
> > > > >>> at
> > > > >>
> > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> > > > >>> at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > > > >>> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > > > >>> at
> > > > >>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > > > >>> at java.lang.Thread.run(Thread.java:662)
> > > > >>>
> > > > >>> Therefor I have not been able to do a run of the test, yet.
> However
> > > if
> > > > >>> someone would be willing to run it I can just attach it to the
> > issue.
> > > > >>>
> > > > >>> Regards,
> > > > >>> Julian
> > > > >>>
> > > > >>>> Hi Ted,
> > > > >>>>
> > > > >>>> I've been unable to squeeze time for writing unit test for BDCI
> > due
> > > to
> > > > >> my
> > > > >>>> tight schedule lately. I will try to submit the patch with unit
> > test
> > > > >> next
> > > > >>>> week.
> > > > >>>>
> > > > >>>> Thanks,
> > > > >>>> Anil
> > > > >>>>
> > > > >>>> On Sat, Sep 15, 2012 at 7:56 AM, Ted Yu <yuzhihong@gmail.com>
> > > wrote:
> > > > >>>>
> > > > >>>>> Anil:
> > > > >>>>> Thanks for the sharing.
> > > > >>>>> If you add a test to HBASE-6669 showing use of
> > > > >>> BigDecimalColumnInterpreter,
> > > > >>>>> your patch would be more easily acceptable.
> > > > >>>>>
> > > > >>>>> Cheers
> > > > >>>>>
> > > > >>>>> On Fri, Sep 14, 2012 at 3:17 PM, anil gupta <
> > anilgupta84@gmail.com
> > > >
> > > > >>> wrote:
> > > > >>>>>
> > > > >>>>>> Hi Guys,
> > > > >>>>>>
> > > > >>>>>> The regionservers need to have the jar which contains the
> > > > >>>>>> BigDecimalColumnInterpreter class in their classpath. I was
> > > > >>> successfully
> > > > >>>>>> able to run the utility class once i copied the jar across the
> > > > >> cluster
> > > > >>>>> and
> > > > >>>>>> rebooted the cluster. Also, please specify the following
> > property
> > > in
> > > > >>>>>> hbase-site.xml to load the co-processor:
> > > > >>>>>> <property>
> > > > >>>>>>        <name>hbase.coprocessor.region.classes</name>
> > > > >>>>>>
> > > > >>>>>>
> > > > >>>>>
> > > > >>>
> > > > >>
> > > >
> > >
> >
> <value>org.apache.hadoop.hbase.coprocessor.AggregateImplementation</value>
> > > > >>>>>> </property>
> > > > >>>>>>
> > > > >>>>>> Let me know once you guys try this out.
> > > > >>>>>>
> > > > >>>>>> Thanks,
> > > > >>>>>> Anil Gupta
> > > > >>>>>>
> > > > >>>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Thanks & Regards,
> > > > >> Anil Gupta
> > > > >>
> > > >
> > >
> >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
> >
>

--047d7b6d8b285d8f2204cb2a1ad4--