Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@crunch.apache.org
Received-SPF: pass (nike.apache.org: domain of danushka.menikkumbura@gmail.com
 designates 209.85.212.173 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAH29n6NHntzuJ9soh3VNYNx3CWtSKpP7U7D_HrEEYmuy=bCDMw@mail.gmail.com>
References: 
 <CAF4V=3GmEnc4kP=afT-j3YY6Ku6_nDhoGVGWiAZ7NVnvT6-FoQ@mail.gmail.com>
 <CAH29n6Pcnstb75AdCbeE_e2xwwkVynQb6UWaSCnf4JaAHQCD1A@mail.gmail.com>
 <CAF4V=3HNTwXCqoPDc5s98waPHT4bvONWUq78j+qm7ZsygxoH1Q@mail.gmail.com>
 <CAH29n6P35eibgMkzwqJvL4LZcGztJJ6stArWLeKcoY2EsRvT_Q@mail.gmail.com>
 <CAF4V=3Hi98xPCrs_Tg8UGefhty7fMiSp5OnNbD2-h6PPW+YSkA@mail.gmail.com>
 <CAH29n6Mjd6vD0RkB38qWnYOm0dX2iXhYAKbpZtYj-h2iGp7--Q@mail.gmail.com>
 <CAF4V=3H9YF2ijmgoroZ50BH5txDA27wmvB3NakXWQD=eNMOKQA@mail.gmail.com>
 <CAH29n6NHntzuJ9soh3VNYNx3CWtSKpP7U7D_HrEEYmuy=bCDMw@mail.gmail.com>
From: Danushka Menikkumbura <danushka.menikkumbura@gmail.com>
Date: Tue, 14 Oct 2014 10:28:43 -0400
Message-ID: 
 <CAF4V=3F8-2sX2yQsfvG-XgPaSNdhW14H5aco-cTv4DpH3HA5NQ@mail.gmail.com>
Subject: Re: Test failure on the master branch
To: dev <dev@crunch.apache.org>
Content-Type: multipart/alternative; boundary=bcaec53d5eb5dd4b64050562d69b

--bcaec53d5eb5dd4b64050562d69b
Content-Type: text/plain; charset=UTF-8

Thanks J!

On Tue, Oct 14, 2014 at 9:57 AM, Josh Wills <jwills@cloudera.com> wrote:

> I'm still rocking 1.7. Will give 1.8 a whirl this evening.
>
> J
>
> On Tue, Oct 14, 2014 at 6:53 AM, Danushka Menikkumbura <
> danushka.menikkumbura@gmail.com> wrote:
>
> > I am on Ubuntu 14.04.1 LTS and Java 1.8.0_20.
> >
> > BTW maybe it is a result of the commit
> > 3f98411364cec32a0a8c6681dfaabd43caa4dd60?.
> >
> > Thanks,
> > Danushka
> >
> >
> >
> > On Tue, Oct 14, 2014 at 9:44 AM, Josh Wills <jwills@cloudera.com> wrote:
> >
> > > No, master is compatible w/Hadoop 1; the error you're seeing is caused
> by
> > > the HBase testing code being flaky. I've experienced the flaky
> > > HFileTargetIT test on my machine before, but never on a regular basis.
> > Can
> > > you give me the basics of your setup-- OS, java version, etc.?
> > >
> > > On Tue, Oct 14, 2014 at 6:38 AM, Danushka Menikkumbura <
> > > danushka.menikkumbura@gmail.com> wrote:
> > >
> > > > No I don't.
> > > >
> > > > That means the master branch is not compatible with Hadoop 1?
> > > >
> > > > Thanks,
> > > > Danushka
> > > >
> > > > On Tue, Oct 14, 2014 at 9:26 AM, Josh Wills <jwills@cloudera.com>
> > wrote:
> > > >
> > > > > Hrm, okay. Do you get it if you use the -Dcrunch.platform=2 option?
> > > > >
> > > > > On Tue, Oct 14, 2014 at 6:23 AM, Danushka Menikkumbura <
> > > > > danushka.menikkumbura@gmail.com> wrote:
> > > > >
> > > > > > Yes. I get it every time I try to build HBase module.
> > > > > >
> > > > > > FYI : org.apache.crunch.io.hbase.HFileTargetIT is the test in
> > error.
> > > > > >
> > > > > > Thanks,
> > > > > > Danushka
> > > > > >
> > > > > > On Tue, Oct 14, 2014 at 9:15 AM, Josh Wills <jwills@cloudera.com
> >
> > > > wrote:
> > > > > >
> > > > > > > That can happen intermittently if the local HBase cluster gets
> > hung
> > > > > up--
> > > > > > do
> > > > > > > you get it regularly (i.e., every time you run?)
> > > > > > >
> > > > > > > J
> > > > > > >
> > > > > > > On Tue, Oct 14, 2014 at 6:08 AM, Danushka Menikkumbura <
> > > > > > > danushka.menikkumbura@gmail.com> wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I am getting the following test failure while building
> Crunch.
> > > Have
> > > > > you
> > > > > > > got
> > > > > > > > an idea as to what may be the issue here?.
> > > > > > > >
> > > > > > > > 34787 [Thread-2057] INFO
> > > > > > > >
> > > > > >
> > org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob
> > > > -
> > > > > > > > Job status available at: http://localhost:8080/
> > > > > > > > 44548 [M:0;danushka:38318.oldLogCleaner] ERROR
> > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager  -
> Connection
> > > not
> > > > > > found
> > > > > > > > in the list, can't delete it (connection
> > > > > > > >
> > key=HConnectionKey{properties={hbase.zookeeper.quorum=localhost,
> > > > > > > > hbase.rpc.timeout=60000,
> > > hbase.zookeeper.property.clientPort=57963,
> > > > > > > > zookeeper.znode.parent=/hbase,
> hbase.client.retries.number=350,
> > > > > > > > hbase.client.pause=100}, username='danushka'}). May be the
> key
> > > was
> > > > > > > > modified?
> > > > > > > > java.lang.Exception
> > > > > > > > at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:493)
> > > > > > > > at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:429)
> > > > > > > > at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.stop(ReplicationLogCleaner.java:141)
> > > > > > > > at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.master.cleaner.CleanerChore.cleanup(CleanerChore.java:276)
> > > > > > > > at org.apache.hadoop.hbase.Chore.run(Chore.java:94)
> > > > > > > > at java.lang.Thread.run(Thread.java:745)
> > > > > > > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time
> elapsed:
> > > > > 21.625
> > > > > > > sec
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Danushka
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Director of Data Science
> > > > > > > Cloudera <http://www.cloudera.com>
> > > > > > > Twitter: @josh_wills <http://twitter.com/josh_wills>
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Director of Data Science
> > > > > Cloudera <http://www.cloudera.com>
> > > > > Twitter: @josh_wills <http://twitter.com/josh_wills>
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Director of Data Science
> > > Cloudera <http://www.cloudera.com>
> > > Twitter: @josh_wills <http://twitter.com/josh_wills>
> > >
> >
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>

--bcaec53d5eb5dd4b64050562d69b--