hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeffrey Zhong <jzh...@hortonworks.com>
Subject Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is available. Please vote by Feb 19 2015
Date Sat, 21 Feb 2015 07:05:05 GMT

+1. I have compiled & run Phoenix master branch code(with some code
changes) on top of Hbase 1.0.0. All Phoenix tests are passed and one issue
is found(https://issues.apache.org/jira/browse/HBASE-13077)

Thanks,
-Jeffrey

On 2/20/15, 12:38 AM, "Enis Söztutar" <enis@apache.org> wrote:

>Thanks for tests and votes so far.
>
>Here is my official +1 (see above for my tests).
>
>I was inspecting a similar issue today in the cluster with
>IntegrationTestLoadAndVerify with destructive CM, and the log splitting
>did
>not finish in 3 attempts. I think the issue is a not that critical though,
>I think it is due to a race between timeout monitor and some slowness in
>task heartbeat due to a loaded master (will open a jira if I nail down the
>exact reason).
>
>We need at least one more vote. I'll extend the voting for this RC (RC5)
>until 20th midnight PST. Please let me know if you intend to spend some
>more time on testing. We can extend the deadline.
>
>Cheers,
>Enis
>
>On Thu, Feb 19, 2015 at 6:12 PM, Andrew Purtell <apurtell@apache.org>
>wrote:
>
>> Maybe its just me
>>
>>
>> On Thu, Feb 19, 2015 at 11:10 AM, Enis Söztutar <enis.soz@gmail.com>
>> wrote:
>>
>> > I did not run the unit tests locally. I was relying on the following
>> build
>> > which is 100% pass:
>> >
>> > https://builds.apache.org/view/All/job/HBase-1.0/746/
>> >
>> > It has the exact RC5 bits (6c98bff7b719efdb16f71606f3b7d8229445eb81).
>>Let
>> > me kick a local UT run just in case.
>> >
>> > Enis
>> >
>> > On Thu, Feb 19, 2015 at 9:05 AM, Andrew Purtell <apurtell@apache.org>
>> > wrote:
>> >
>> > > That list is missing unit testing. Did you happen to do that when
>> > building
>> > > but not mention it Enis? If so did they all pass for you?
>> > >
>> > > On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <enis.soz@gmail.com>
>> > wrote:
>> > >
>> > > > Here is my RC5 testing so far:
>> > > >
>> > > >  - checked checksums, sigs
>> > > >  - checked the bin and src artifacts
>> > > >  - checked layouts
>> > > >  - checked java files in src tarball, and jar files in bin tarball
>> > > >  - checked the book and the site (they are new style)
>> > > >  - checked javadocs for both devapi and userapi
>> > > >  - checked reported version, build time, revision
>> > > >  - run some smoke tests using shell
>> > > >  - started local mode
>> > > >  - run LTT local mode
>> > > >  - checked the webUIs of master and region servers
>> > > >  - checked JMX dump and debug dump
>> > > >  - Build src with hadoop versions  2.2.0 2.3.0 2.4.0 2.4.1 2.5.0
>> 2.5.1
>> > > > 2.5.2 2.6.0
>> > > > - Deployed at a 6 node cluster with Hadoop-2.6.0
>> > > > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX
>>encoding
>> > > > - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY
>>compression
>> > > > - Tested with Bucket cache with 500M off heap
>> > > >
>> > > > I am still running larger scale tests, and some CM tests on the
>> > cluster.
>> > > > Will report back tomorrow and cast my vote.
>> > > >
>> > > > Enis
>> > > >
>> > > >
>> > > > On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <palomino219@gmail.com>
wrote:
>> > > >
>> > > > > TestCacheOnWrite itself has some problems. It
>> > > > > uses TestHFileWriterV2.randomOrderedKey to generate a random
>>byte
>> > > array,
>> > > > > then use first 32 bytes as row and other parts as family and
>> > qualifier,
>> > > > but
>> > > > > TestHFileWriterV2.randomOrderedKey may return a byte array only
>> > > contains
>> > > > 32
>> > > > > bytes, so there will be family and qualifier with zero length.
>> > > > >
>> > > > > I do not know if this is the reason why this test is flaky
>>since it
>> > > use a
>> > > > > Random with pre-defined seed so the random sequence should be
>> > stable. I
>> > > > can
>> > > > > modify the KeyValue generation part to see if it helps.
>> > > > >
>> > > > > BTW, the name 'randomOrderedKey' is ambiguous, may change to
'
>> > > > > randomOrderedRow'?
>> > > > >
>> > > > > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <apurtell@apache.org>:
>> > > > >
>> > > > > > I'm not able to get a clean unit test run when building
from
>> source
>> > > > using
>> > > > > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for
me,
>>maybe
>> > > more
>> > > > > but
>> > > > > > the build doesn't get past hbase-server. Maybe these are
known
>> > > issues?
>> > > > If
>> > > > > > not I'll dig in when I get some time.
>> > > > > >
>> > > > > >
>> > > > > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar
>><enis@apache.org>
>> > > > wrote:
>> > > > > >
>> > > > > > > It gives me great pleasure to announce that the sixth
>>release
>> > > > candidate
>> > > > > > for
>> > > > > > > the release
>> > > > > > > 1.0.0 (HBase-1.0.0RC5), is available for download at
>> > > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>> > > > > > >
>> > > > > > > Maven artifacts are also available in the temporary
>>repository
>> > > > > > >
>> > > >
>> https://repository.apache.org/content/repositories/orgapachehbase-1065
>> > > > > > >
>> > > > > > > Signed with my code signing key E964B5FF. Can be found
here:
>> > > > > > > https://people.apache.org/keys/committer/enis.asc
>> > > > > > >
>> > > > > > >  Signed tag in the repository can be found here:
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> 
>>https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46
>>c917a9aba2106be4bf74182a764
>> > > > > > >
>> > > > > > > HBase 1.0.0 is the next stable release, and the start
of
>> > "semantic
>> > > > > > > versioned"
>> > > > > > > releases (See [1]).
>> > > > > > >
>> > > > > > > The theme of 1.0.0 release is to become a stable base
for
>> future
>> > > 1.x
>> > > > > > series
>> > > > > > > of releases. We aim to achieve at least the same level
of
>> > stability
>> > > > of
>> > > > > > 0.98
>> > > > > > > releases.
>> > > > > > >
>> > > > > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release.
>> > Together
>> > > > > with
>> > > > > > > the
>> > > > > > > previous 0.99.x releases, major changes in 1.0.0 are
listed
>> (but
>> > > not
>> > > > > > > limited to)
>> > > > > > > below. Note that all previous 0.99.x releases are developer
>> > preview
>> > > > > > > releases, and will
>> > > > > > > NOT be supported in any form.
>> > > > > > >
>> > > > > > > API Cleanup and changes
>> > > > > > >   1.0.0 introduces new APIs, and deprecates some of
>> commonly-used
>> > > > > > >   client side APIs (HTableInterface, HTable and HBaseAdmin).
>> > > > > > >   We advise to update your application to use the new
style
>>of
>> > > APIs,
>> > > > > > since
>> > > > > > >   deprecated APIs might be removed in future releases
(2.x).
>> See
>> > > [2]
>> > > > > and
>> > > > > > > [3]
>> > > > > > >   for an overview of changes. All Client side API's
are
>>marked
>> > with
>> > > > > > >   InterfaceAudience.Public class, indicating that the
>> > class/method
>> > > is
>> > > > > an
>> > > > > > >   official "client API" for HBase. All 1.x releases
are
>>planned
>> > to
>> > > be
>> > > > > API
>> > > > > > >   compatible for these classes. See [1] for an overview.
>> > > > > > >
>> > > > > > > Master runs a Region Server as well
>> > > > > > >   Starting with 1.0.0, the HBase master server and
backup
>> master
>> > > > > servers
>> > > > > > > will
>> > > > > > >   also act as a region server. RPC port and info port
for
>>web
>> UI
>> > is
>> > > > > > shared
>> > > > > > > for
>> > > > > > >   the master and region server roles. Active master
can host
>> > > regions
>> > > > of
>> > > > > > >   defined tables if configured (disabled by default).
Backup
>> > > masters
>> > > > > will
>> > > > > > > not
>> > > > > > >   host regions.
>> > > > > > >
>> > > > > > > Read availability using timeline consistent region
replicas
>> > > > > > >   This release contains Phase 1 items for experimental
"Read
>> > > > > availability
>> > > > > > > using
>> > > > > > >   timeline consistent region replicas" feature. A region
>>can be
>> > > > hosted
>> > > > > in
>> > > > > > >   multiple region servers in read-only mode. One of
the
>> replicas
>> > > for
>> > > > > the
>> > > > > > > region
>> > > > > > >   will be primary, accepting writes, and other replicas
>>will be
>> > > > sharing
>> > > > > > the
>> > > > > > > same
>> > > > > > >   data files. Read requests can be done against any
replica
>>for
>> > the
>> > > > > > region
>> > > > > > > with
>> > > > > > >   backup RPCs for high availability with timeline
>>consistency
>> > > > > guarantees.
>> > > > > > > More
>> > > > > > >   information can be found at HBASE-10070.
>> > > > > > >
>> > > > > > > Online config change and other forward ports from 0.89-fb
>> branch
>> > > > > > >   HBASE-12147 forward ported online config change which
>>enables
>> > > some
>> > > > of
>> > > > > > the
>> > > > > > >   configuration from the server to be reloaded without
>> restarting
>> > > the
>> > > > > > > region
>> > > > > > >   servers.
>> > > > > > >
>> > > > > > > Other notable improvements in 1.0.0 (including previous
>>0.99.x)
>> > are
>> > > > > > >  - A new web skin in time for 1.0 (http://hbase.apache.org)
>> > > > > > >  - Automatic tuning of global memstore and block cache
sizes
>> > > > > > >  - Various security, tags and visibility labels improvements
>> > > > > > >  - Bucket cache improvements (usability and compressed
data
>> > blocks)
>> > > > > > >  - A new pluggable replication endpoint to plug in
to
>>HBase's
>> > > > > > inter-cluster
>> > > > > > >    replication to replicate to a custom data store
>> > > > > > >  - A Dockerfile to easily build and run HBase from
source
>> > > > > > >  - Truncate table command
>> > > > > > >  - Region assignment to use hbase:meta table instead
of
>> zookeeper
>> > > for
>> > > > > > > faster
>> > > > > > >    region assignment (disabled by default)
>> > > > > > >  - Extensive documentation improvements
>> > > > > > >  - [HBASE-12511] - namespace permissions - add support
from
>> table
>> > > > > > creation
>> > > > > > > privilege in a namespace 'C'
>> > > > > > >  - [HBASE-12568] - Adopt Semantic Versioning and document
>>it in
>> > the
>> > > > > book
>> > > > > > >  - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support
>>for
>> > > Thrift
>> > > > > > Server
>> > > > > > >  - [HBASE-12651] - Backport HBASE-12559 'Provide
>>LoadBalancer
>> > with
>> > > > > online
>> > > > > > > configuration capability' to branch-1
>> > > > > > >  - [HBASE-10560] - Per cell TTLs
>> > > > > > >  - [HBASE-11997] - CopyTable with bulkload
>> > > > > > >  - [HBASE-11990] - Make setting the start and stop
row for a
>> > > specific
>> > > > > > > prefix easier
>> > > > > > >  - [HBASE-12220] - Add hedgedReads and hedgedReadWins
>>metrics
>> > > > > > >  - [HBASE-12090] - Bytes: more Unsafe, more Faster
>> > > > > > >  - [HBASE-12032] - Script to stop regionservers via
RPC
>> > > > > > >  - [HBASE-11907] - Use the joni byte[] regex engine
in
>>place of
>> > > > > j.u.regex
>> > > > > > > in RegexStringComparator
>> > > > > > >  - [HBASE-11796] - Add client support for atomic
>>checkAndMutate
>> > > > > > >  - [HBASE-11804] - Raise default heap size if unspecified
>> > > > > > >  - [HBASE-11890] - HBase REST Client is hard coded
to http
>> > protocol
>> > > > > > >  - [HBASE-12126] - Region server coprocessor endpoint
>> > > > > > >  - [HBASE-12183] - FuzzyRowFilter doesn't support reverse
>>scans
>> > > > > > >  - [HBASE-12075] - Preemptive Fast Fail
>> > > > > > >  - [HBASE-12354] - Update dependencies in time for
1.0
>>release
>> > > > > > >  - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works
with
>> > > > > MIN_VERSIONS
>> > > > > > >  - [HBASE-12434] - Add a command to compact all the
regions
>>in
>> a
>> > > > > > > regionserver
>> > > > > > >  - [HBASE-8707]  - Add LongComparator for filter
>> > > > > > >  - [HBASE-12286] - [shell] Add server/cluster online
load of
>> > > > > > configuration
>> > > > > > > changes
>> > > > > > >  - [HBASE-12361] - Show data locality of region in
table
>>page
>> > > > > > >   - [HBASE-12496] - A blockedRequestsCount metric
>> > > > > > >  - [HBASE-12730] - Backport HBASE-5162 (Basic client
>>pushback
>> > > > > mechanism)
>> > > > > > to
>> > > > > > > branch-1
>> > > > > > >  - [HBASE-12731] - Heap occupancy based client pushback
>> > > > > > >  - [HBASE-12728] - buffered writes substantially less
useful
>> > after
>> > > > > > removal
>> > > > > > > of HTablePool
>> > > > > > >  - [HBASE-5699] - Run with > 1 WAL in HRegionServer
>> > > > > > >   - Various fixes to REST server
>> > > > > > >  - Internal refactoring for abstracting away zookeeper
usage
>> > > > > > >  - Better support for Cell interface internally in
read and
>> write
>> > > > paths
>> > > > > > for
>> > > > > > >    better performance and flexibility
>> > > > > > >  - Combining internal mvcc and seqId infrastructure
>> > > > > > >  - Ring buffer based WAL improvements
>> > > > > > >  - Switch to using new style of client APIs internally
(in a
>> lot
>> > of
>> > > > > > places)
>> > > > > > >  - Improvements in visibility labels
>> > > > > > >  - Perf improvements
>> > > > > > >  - Numerous improvements in other areas and bug fixes.
>> > > > > > >
>> > > > > > > 1.0.0 release has these changes in default behavior
(see
>>[4])
>> > > > > > >   - Zookeeper 3.4.x is required
>> > > > > > >  - Hadoop-2.x is required
>> > > > > > >  - JDK-1.7 is required
>> > > > > > >  - Default ports have changed from 600XX range into
out of
>> > > ephemeral
>> > > > > > 160XX
>> > > > > > > range.
>> > > > > > >  - Hfile version 3 has been enabled by default.
>> > > > > > >  - Slab cache has been removed (use bucket cache instead)
>> > > > > > >  - Default heap for region servers (and master) is
changed
>>from
>> > 1GB
>> > > > to
>> > > > > > >    the jdk's default. On most platforms, it will default
to
>>1/4
>> > of
>> > > > > > physical
>> > > > > > >    memory
>> > > > > > >  - Some client facing APIs (HTableInterface, etc) has
been
>> > > deprecated
>> > > > > and
>> > > > > > >    replaced.
>> > > > > > >  - Custom Filter implementations should switch to using
the
>>new
>> > > > > > recommended
>> > > > > > > APIs.
>> > > > > > >  - Some authorization permissions (especially regarding
>> > namespaces)
>> > > > > have
>> > > > > > > been
>> > > > > > >    changed (HBASE-12511, HBASE-8015)
>> > > > > > >  - Mapred package and classes under there has been
>> un-deprecated.
>> > > > > > >   - Two new modules (jar files): hbase-annotations
and
>> > hbase-rest.
>> > > > > > >  - HTrace dependency is moved to the Apache artifacts
(
>> > > > > > > https://htrace.incubator.apache.org/)
>> > > > > > >  - Various updates to dependency versions
>> > > > > > >
>> > > > > > > Full list of the issues can be found at:
>> > > > > > >  - 1.0.0 issues  :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> 
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12325852
>> > > > > > >  - 0.99.2 issues :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> 
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12325675
>> > > > > > >  - 0.99.1 issues :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> 
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12328551
>> > > > > > >  - 0.99.0 issues :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> 
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12328822
>> > > > > > >
>> > > > > > > Compatibility
>> > > > > > > -------------
>> > > > > > > Source Compatibility:
>> > > > > > > Client side code in HBase-1.0.0 is (mostly) source
>>compatible
>> > with
>> > > > > > earlier
>> > > > > > > versions. Some minor API changes might be needed from
the
>> client
>> > > > side.
>> > > > > > >
>> > > > > > >
>> > > > > > > Wire Compatibility:
>> > > > > > > HBase-1.0.0 release is wire compatible with 0.98.x
releases.
>> > > Clients
>> > > > > and
>> > > > > > > servers running in different versions as long as new
>>features
>> are
>> > > not
>> > > > > > used
>> > > > > > > should be possible.
>> > > > > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is
>>supported as
>> > > well.
>> > > > > > 1.0.0
>> > > > > > > introduces a new file format (hfile v3) that is enabled
by
>> > default
>> > > > that
>> > > > > > > 0.96.x code cannot read. Thus, rolling upgrade from
0.96
>> directly
>> > > to
>> > > > > > 1.0.0
>> > > > > > > is
>> > > > > > > not supported.
>> > > > > > > 1.0.0 is NOT wire compatible with earlier releases
(0.94,
>>etc).
>> > > > > > >
>> > > > > > > Binary Compatibility:
>> > > > > > > Binary compatibility at the Java API layer with earlier
>> versions
>> > > > > (0.98.x,
>> > > > > > > 0.96.x and 0.94.x) is not supported. You may have to
>>recompile
>> > your
>> > > > > > client
>> > > > > > > code and any server side code (coprocessors, filters
etc)
>> > referring
>> > > > to
>> > > > > > > hbase jars.
>> > > > > > >
>> > > > > > > Upgrading
>> > > > > > > ---------
>> > > > > > > See [4] for upgrade instructions and extended discussion
on
>>the
>> > > > > changes.
>> > > > > > >
>> > > > > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade
or
>>rolling
>> > > > upgrade
>> > > > > > > fashion
>> > > > > > > is supported.
>> > > > > > >
>> > > > > > > From 0.96.x : Upgrade from 0.96.x is supported with
a
>>shutdown
>> > and
>> > > > > > restart
>> > > > > > > of
>> > > > > > > the cluster.
>> > > > > > >
>> > > > > > > From 0.94.x : Upgrade from 0.94.x is supported similar
to
>> upgrade
>> > > > from
>> > > > > > > 0.94 -> 0.96. The upgrade script should be run to
rewrite
>> cluster
>> > > > level
>> > > > > > > metadata.
>> > > > > > > See [5] for details.
>> > > > > > >
>> > > > > > >
>> > > > > > > Supported Hadoop versions
>> > > > > > > -------------------------
>> > > > > > > 1.0.0 release drops support for Hadoop-1.x releases.
Only
>> > > Hadoop-2.x
>> > > > > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x
and
>> > Hadoop-2.6.x
>> > > > > > > releases
>> > > > > > > are the most tested hadoop releases and we recommend
running
>> with
>> > > > those
>> > > > > > > versions
>> > > > > > > (or later versions). Earlier Hadoop-2 based releases
>> > (hadoop-2.2.x
>> > > > and
>> > > > > > > 2.3.x)
>> > > > > > > are not tested to the full extend. More information
can be
>> found
>> > > > here:
>> > > > > > > https://hbase.apache.org/book/configuration.html#hadoop
>> > > > > > >
>> > > > > > >
>> > > > > > > Supported Java versions
>> > > > > > > -------------------------
>> > > > > > > 1.0.0 release drops support for JDK6. Only JDK7 is
>>supported.
>> > JDK8
>> > > > > > support
>> > > > > > > is experimental. More information can be found here:
>> > > > > > > https://hbase.apache.org/book/configuration.html#java
>> > > > > > >
>> > > > > > >
>> > > > > > > Voting
>> > > > > > >  ------
>> > > > > > > Please try to test and vote on this release by Feb
19 2015
>> > 11:59PM
>> > > > PDT.
>> > > > > > > We will have a 5 day voting period because this is
the sixth
>> RC.
>> > > > Please
>> > > > > > try
>> > > > > > > to
>> > > > > > > spend some time for testing this important release.
>> > > > > > >
>> > > > > > > [] +1 Release the artifacts as 1.0.0
>> > > > > > > [] -1 DO NOT release the artifacts as 1.0.0, because...
>> > > > > > >
>> > > > > > > Gratitute
>> > > > > > > ---------
>> > > > > > > Last but not least, 1.0.0 release has been in a long
time
>> making
>> > > with
>> > > > > > > contributions from a very large group of awesome people
and
>> hard
>> > > work
>> > > > > > from
>> > > > > > > committers and contributors. We would like to extend
our
>>thanks
>> > to
>> > > > > > > everybody
>> > > > > > > who worked on this release or contributed to HBase
over the
>> > years.
>> > > > > > >
>> > > > > > >
>> > > > > > > References
>> > > > > > > ----------
>> > > > > > > [1]
>> > https://hbase.apache.org/book/upgrading.html#hbase.versioning
>> > > > > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
>> > > > > > > [3] http://s.apache.org/hbase-1.0-api
>> > > > > > > [4]
>> > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
>> > > > > > > [5]
>> > > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>> > > > > > >
>> > > > > > > Enis
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > > Best regards,
>> > > > > >
>> > > > > >    - Andy
>> > > > > >
>> > > > > > Problems worthy of attack prove their worth by hitting back.
-
>> Piet
>> > > > Hein
>> > > > > > (via Tom White)
>> > > > > >
>> > > > >
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Best regards,
>> > >
>> > >    - Andy
>> > >
>> > > Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein
>> > > (via Tom White)
>> > >
>> >
>>
>>
>>
>> --
>> Best regards,
>>
>>    - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
>>

Mime
View raw message