accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Turner <ke...@deenlo.com>
Subject Re: [VOTE] Apache Accumulo 1.5.1-RC3
Date Thu, 27 Feb 2014 23:38:07 GMT
On Thu, Feb 27, 2014 at 6:16 PM, Christopher <ctubbsii@apache.org> wrote:

> +1
>
> I've run my verifier script [1] several times, on CentOS 6.5, Fedora
> 19, Fedora 20 (at least half a dozen now, and at least twice on each),
> to  verify the following:
>
> All signatures and hashes are good, including the RPM sigs.
> Jars have sources/javadocs, are sealed, and match the binary tarball
> contents.
> Source tarball matches the git tag (3478f71a), and builds with and
> without tests with the configured hadoop.profile=1 and
> hadoop.profile=2.
>
> Some of the integration tests time out occasionally on a CentOS 6.5
> build in a VM, but I'm not too concerned about the time-sensitivity in
> those tests.
>
> Did the following tests on CentOS 6.5, Hadoop 1.2.1, ZK 3.4.5,
> (3GB-standalone-native), OpenJDK 1.6
> (java-1.6.0-openjdk-1.6.0.0-3.1.13.1.el6_5.x86_64):
> Started/stopped a single-node cluster, created/deleted tables, ran
> test/verify ingest (test/system/test1)
> Write performance (5 threads * ~40k mut/sec = ~200k mut/sec)
> Read performance (5 threads * ~109k rec/sec = ~545k rec/sec)
>

I am seeing slow write speeds when running test/system/test1/ingest_test.sh
w/ a single node Hadoop 2.2.0.  I have confirmed this is ACCUMULO-1905,
when I increase tserver.mutation.queue.max to 4M, write rates are around
200k mut/sec.   When tserver.mutation.queue.max is at the default value, it
writes at around 1/5th the speed. I added some notes to 1905.


>
> I did run into a strange bug where I couldn't start the master... the
> java process would just die unexpectedly while setting up log4j,
> without logging anything to stdout or stderr. The problem was fixed
> after a reboot, so I wasn't able to reproduce or debug it, and I don't
> think it's an Accumulo bug (probably kernel or openjdk bug).
>
> [1]: https://github.com/ctubbsii/rc-verify
>
> --
> Christopher L Tubbs II
> http://gravatar.com/ctubbsii
>
>
> On Tue, Feb 25, 2014 at 5:17 PM, Keith Turner <keith@deenlo.com> wrote:
> > I ran a utility [1] to analyze API diffs [2] between 1.5.0 and 1.5.1-RC3.
> > The configs I used are the two xml files in the parent [3] of the report.
> > I think the diff looks ok.  I used jars from 1.5.0 and 1.5.1-RC3
> bin.tar.gz.
> >
> > [1] : http://ispras.linuxbase.org/index.php/Java_API_Compliance_Checker
> > [2] :
> > http://people.apache.org/~kturner/1.5.0_to_1.5.1-RC3/compat_report.html
> > [3] : http://people.apache.org/~kturner/1.5.0_to_1.5.1-RC3/
> >
> >
> >
> >
> > On Mon, Feb 24, 2014 at 8:01 PM, Josh Elser <josh.elser@gmail.com>
> wrote:
> >
> >> All,
> >>
> >> Please consider the following candidate as Apache Accumulo 1.5.1 -- now
> >> with 100% more CHANGES changes.
> >>
> >> Git artifacts: The staging repository was built from the tag "1.5.1-rc3"
> >> (3478f71a).
> >>
> >> Maven Staging Repo: https://repository.apache.org/content/repositories/
> >> orgapacheaccumulo-1002
> >>
> >> Source tarball: http://repository.apache.org/content/repositories/
> >> orgapacheaccumulo-1002/org/apache/accumulo/accumulo/1.5.
> >> 1/accumulo-1.5.1-src.tar.gz
> >>
> >> Binary tarball: http://repository.apache.org/content/repositories/
> >> orgapacheaccumulo-1002/org/apache/accumulo/accumulo/1.5.
> >> 1/accumulo-1.5.1-bin.tar.gz
> >>
> >> Changes since 1.5.1-RC2: ACCUMULO-2324, ACCUMULO-2361, ACCUMULO-2369,
> >> ACCUMULO-2378, ACCUMULO-2379, ACCUMULO-2380, ACCUMULO-2385,
> ACCUMULO-2387,
> >> ACCUMULO-2390
> >>
> >> Keys: http://www.apache.org/dist/accumulo/KEYS
> >>
> >> Final CHANGES:
> https://git-wip-us.apache.org/repos/asf?p=accumulo.git;a=
> >> blob_plain;f=CHANGES;hb=3478f71ae888f8d73aaa93837319a6dbb4ba0c8a
> >>
> >> Testing: Unit test and auto-tests passed successfully. Ran a short
> (~2hrs)
> >> CI on 6 node installation. Ran a brief (~1hr) CI test on one machine
> with
> >> the newly-released Hadoop-2.3.0. Built from src tarball, and verified
> >> functionality with bin tarball.
> >>
> >> Since there are very minor changes compared to 1.5.1-RC2, this vote will
> >> be open for the next 72 hours (2/28/2014 0100 UTC).
> >>
> >> Upon successful completion of this vote, a 1.5.1 gpg-signed Git tag will
> >> be created from 3478f71a and the above staging repository will be
> promoted.
> >>
> >> - Josh
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message