hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Elliott Clark <ecl...@apache.org>
Subject Re: [VOTE] The 6th hbase-0.96.0 release candidate is available for download
Date Fri, 18 Oct 2013 19:37:17 GMT
I'm -0 this being the first 96 release.

For the good news:
* On a small cluster I've run all of the IT tests with both the calm
chaos monkey and the slow deterministic chaos monkey.  Everything
passed and looked good.  4 tests  of 5 hours each pass consistently.
* Runs of YCSB Reads were better than stock 0.94 (naggles and short
scans were the big wins).
* This works well with Hadoop 2.2.0
* Thanks to the znode watcher our MTTR if a region server crashes is
pretty great.
* Protobuf means our wire compat story is great.
* The client module and the Testing util module mean that for
downstreamers using HBase is easier than ever.
* I see really large jumps in read and write throughput when the
balancer runs so it looks like the new balancer does a good job.
* Tar's are signed and look good
* The jars are in place.

For the Bad news:
* This release won't scale up to large clusters busy cluster.  The
client uses way too many threads.
* Not a single IT test that uses the client from lots of hosts passes
(TestLoadAndVerify or Big Linked List)
* YCSB inserts fail if run from more than one driver node at a time
* YCSB perf is pretty far behind 0.94 until compaction dominate.

For the in-between news:
* Upping the write buffer and lowering the number of async actions
outstanding per server help and can help work around things.  But they
are just work arounds and not everyone can up the write buffer enough
to make this go away.
* This can be fixed without changing anything on the wire so fixing
this in a point release should be possible.


On a larger live serving cluster I can't see this release being
deployed ever.  But I also can't see a short term fix that can be
applied in time for another rc to be cut.


On Thu, Oct 17, 2013 at 2:49 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> +1
>
> I did the following on a single node cluster which runs HBase against
> hadoop-2:
>
> Checked out layouts for artifacts
> Ran TestAcidGuarantees
> Performed several commands using HBase shell
> Ran rowcounter on a small table and verified the result through shell
> 'count' command.
>
> All was good.
>
> On Tue, Oct 15, 2013 at 7:14 PM, Enis Söztutar <enis@hortonworks.com> wrote:
>
>> Spent the day testing the RC. Here is my +1 based on:
>>
>>  - Downloaded artifacts for -hadoop1-bin -hadoop2-bin and -src
>>  - Verified checksums for the artifacts (except for RMD160)
>>    Note: It would be useful if we can get these in a machine readable
>> format to do automated verification with {sha*|md5}sum -c (for the next
>> time)
>>  - Verified signatures
>>  - Checked out documentation
>>  - Checked out layouts for artifacts
>>  - Verified hadoop versions
>>  - Run local cluster
>>  - Build source artifact with hadoop1 and hadoop2
>>  - Run small unit tests
>>  - Deployed on a 7 node cluster with hadoop-2
>>  - Run small tests including LoadTestTool, ITBigLinkedList, ITLoadAndVerify
>> and some shell smoke tests
>>
>> Plus we have been running the tip of 0.96 branch through our test harness
>> including many IT's with and without CM configurations.
>>
>> Let's ship it !
>>
>> Enis
>>
>>
>> On Tue, Oct 15, 2013 at 6:25 PM, Devaraj Das <ddas@hortonworks.com> wrote:
>>
>> > +1. Based on some large scale tests with bits very close to RC5. Found
>> two
>> > issues - HBASE-9773 and HBASE-9777 and neither of them are release
>> blockers
>> > in my mind.
>> >
>> >
>> > On Fri, Oct 11, 2013 at 4:20 PM, Stack <stack@duboce.net> wrote:
>> >
>> > > hbase-0.96.0 will be our next major release.  It is intended to
>> supplant
>> > > the 0.94.x series.
>> > >
>> > > hbase-0.96.0RC5 is our sixth hbase-0.96.0 release candidate.
>> > >
>> > > The signed tarballs are available here:
>> > >
>> > >  http://people.apache.org/~stack/hbase-0.96.0RC5<
>> > > http://people.apache.org/~stack/0.96.0RC5/>
>> > > / <http://people.apache.org/~stack/0.96.0RC5/>
>> > >
>> > > Note that hbase-0.96.0 comes in two flavors; a build that includes and
>> > runs
>> > > on hadoop-1.x and another for hadoop-2.x.  You must chose the hbase
>> that
>> > > suits your hadoop context.
>> > >
>> > > Both sets of hbase artifacts, for hadoop1 and for hadoop2, are
>> available
>> > in
>> > > this maven staging repo:
>> > >
>> > >
>> https://repository.apache.org/content/repositories/orgapachehbase-165/
>> > >
>> > > More than 2k issues [1][2][3][4] are attributed to this version
>> (counting
>> > > fixes done against this and the 0.95.x developer series of releases).
>> >  More
>> > > than 250 fixes have been committed since 0.95.2.  Synopsis of the main
>> > > changes between 0.94.x and 0.96.x will follow soon.
>> > >
>> > > Please take it for a spin.  We are interested in any issues found but
>> in
>> > > particular, we would appreciate feedback on how well the migration of a
>> > > 0.94.x dataset to run under 0.96.0 works [5].
>> > >
>> > > Should this candidate become hbase-0.96.0?  Please vote +/-1 by Friday,
>> > > October 18th.
>> > >
>> > > Thanks,
>> > > St.Ack
>> > >
>> > > 1. 0.96.0 266 issues http://goo.gl/wLmu1Y
>> > > 2. 0.95.2 340 issues http://goo.gl/4djjE9
>> > > 3. 0.95.1 265 issues http://goo.gl/TcdckW
>> > > 4. 0.95.0 1263 issues http://goo.gl/Iqcx2i
>> > > 2. http://hbase.apache.org/book.html#upgrade0.96
>> > >
>> >
>> > --
>> > CONFIDENTIALITY NOTICE
>> > NOTICE: This message is intended for the use of the individual or entity
>> to
>> > which it is addressed and may contain information that is confidential,
>> > privileged and exempt from disclosure under applicable law. If the reader
>> > of this message is not the intended recipient, you are hereby notified
>> that
>> > any printing, copying, dissemination, distribution, disclosure or
>> > forwarding of this communication is strictly prohibited. If you have
>> > received this communication in error, please contact the sender
>> immediately
>> > and delete it from your system. Thank You.
>> >
>>

Mime
View raw message