accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Busbey <busbey...@clouderagovt.com>
Subject Re: Review Request 15650: ACCUMULO-1794 adds hdfs failover to continuous integration test.
Date Wed, 20 Nov 2013 19:38:36 GMT
On Wed, Nov 20, 2013 at 12:00 PM, Keith Turner <keith@deenlo.com> wrote:

> On Mon, Nov 18, 2013 at 12:31 PM, Sean Busbey <busbey+ml@clouderagovt.com
> >wrote:
>
> > Hey Folks,
> >
> > I have a proposed agitator script for flexing Hadoop 2's HDFS HA
> failover.
> > I'm looking for other features of Hadoop 2 that would be relevant for
> > ACCUMULO-1794.
> >
> > One related question I'd like to get a read on: the JobTracker HA in
> CDH4.
> > As a quick recap,CDH4.2.0+ includes HA support for MRv1, including
> > automatic failover between jobtrackers. When a failover occurs, jobs have
> > to restart.
> >
> > I have a similar agitator script to the one for HDFS HA that works to
> fail
> > over the job tracker. JobTracker HA doesn't exist in any Apache Hadoop
> > release, so I'm not sure if I should include it in the general test suite
> > as it would only be applicable to clusters running CDH4+ (unless some
> other
> > distro adds an equivalent administrative command).
> >
> > Thoughts?
> >
>
> I do not see a problem w/ adding this to out test scripts as long as their
> is adequate documentation making it clear its for CDH4.  The continuous
> ingest test do use map reduce.   Would it be better to put this script in
> CDH4?
>
>

Whether it gets included in Apache Accumulo or not, the script will be used
for integration tests on CDH.

The down-side to relying on that is primarily that it will only really get
maintained with a CDH-specific build of Accumulo in mind.

-- 
Sean

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message