accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Turner <ke...@deenlo.com>
Subject Re: Review Request 15650: ACCUMULO-1794 adds hdfs failover to continuous integration test.
Date Wed, 20 Nov 2013 18:00:36 GMT
On Mon, Nov 18, 2013 at 12:31 PM, Sean Busbey <busbey+ml@clouderagovt.com>wrote:

> Hey Folks,
>
> I have a proposed agitator script for flexing Hadoop 2's HDFS HA failover.
> I'm looking for other features of Hadoop 2 that would be relevant for
> ACCUMULO-1794.
>
> One related question I'd like to get a read on: the JobTracker HA in CDH4.
> As a quick recap,CDH4.2.0+ includes HA support for MRv1, including
> automatic failover between jobtrackers. When a failover occurs, jobs have
> to restart.
>
> I have a similar agitator script to the one for HDFS HA that works to fail
> over the job tracker. JobTracker HA doesn't exist in any Apache Hadoop
> release, so I'm not sure if I should include it in the general test suite
> as it would only be applicable to clusters running CDH4+ (unless some other
> distro adds an equivalent administrative command).
>
> Thoughts?
>

I do not see a problem w/ adding this to out test scripts as long as their
is adequate documentation making it clear its for CDH4.  The continuous
ingest test do use map reduce.   Would it be better to put this script in
CDH4?


>
>
> On Mon, Nov 18, 2013 at 11:13 AM, Sean Busbey <sean@manvsbeard.com> wrote:
>
> >
> > -----------------------------------------------------------
> > This is an automatically generated e-mail. To reply, visit:
> > https://reviews.apache.org/r/15650/
> > -----------------------------------------------------------
> >
> > Review request for accumulo and Alex Moundalexis.
> >
> >
> > Bugs: ACCUMULO-1794
> >     https://issues.apache.org/jira/browse/ACCUMULO-1794
> >
> >
> > Repository: accumulo
> >
> >
> > Description
> > -------
> >
> > ACCUMULO-1794 adds hdfs failover to continuous integration test.
> >
> >
> > Diffs
> > -----
> >
> >   test/system/continuous/continuous-env.sh.example
> > 830ae86b5bf2398a840b853423755f6dd65f2dc0
> >   test/system/continuous/hdfs-agitator.pl PRE-CREATION
> >   test/system/continuous/start-agitator.sh
> > 52e5a4e82a4564fa624a71f73ad29fa20ba23246
> >   test/system/continuous/stop-agitator.sh
> > b853a55b12f8402606af52e0748ca50daf95ed7f
> >
> > Diff: https://reviews.apache.org/r/15650/diff/
> >
> >
> > Testing
> > -------
> >
> > Ran the hdfs agitator on a CDH4 cluster configured for HA. it
> successfully
> > caused the active namenode to failover as it went.
> >
> >
> > Thanks,
> >
> > Sean Busbey
> >
> >
>
>
> --
> Sean
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message