Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 83E44102AF for ; Mon, 16 Feb 2015 15:39:41 +0000 (UTC) Received: (qmail 55915 invoked by uid 500); 16 Feb 2015 15:38:42 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 55824 invoked by uid 500); 16 Feb 2015 15:38:42 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 55813 invoked by uid 99); 16 Feb 2015 15:38:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Feb 2015 15:38:42 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [209.85.220.178] (HELO mail-vc0-f178.google.com) (209.85.220.178) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Feb 2015 15:38:38 +0000 Received: by mail-vc0-f178.google.com with SMTP id hq11so10725707vcb.9 for ; Mon, 16 Feb 2015 07:37:57 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=3ZWFX35vAZL/enNyvxLevwbkS2IP8M1Mvdd+mXq94d8=; b=fhBedffc/iVQ1wqCtP0iGWDaI7ihVx9xobtjEoJ7e2m6+yHI8T/vAL22HdrhW8UHaR 2AlFLOz0knO1FrPNfXyGSuxXz0yzKZeR5hrkRk2HsIERlR2D3OEUKvTwGWzW9OS/EQDC 1NSRj3sqJW1xV2TvdxS3mwXg8Ar1JIFxBEeV6iW30MluVpcs00FCTZsUQsWcV1g5Hlns AW4K0VHyxJPp8L5OdHg42FiuaFC5XPkBqDQ+EHDZevyJr3Pln37OwxywRH1WuF5bmgzM Bkbh56uD4pMD9+sgHoNZpox1knsQwaggXn8VmtiXcTBT92R/qUiQ5mwLktD69vpYgUv3 qA+A== X-Gm-Message-State: ALoCoQmrVLyJG+MHtf1ZoAFAzBOTOxvvlLPn8hy0BeL+6UFtFNb6Z3tpXHVrQXK34m6GxOCM+QDU X-Received: by 10.220.123.73 with SMTP id o9mr13636528vcr.77.1424101077028; Mon, 16 Feb 2015 07:37:57 -0800 (PST) MIME-Version: 1.0 Received: by 10.52.146.139 with HTTP; Mon, 16 Feb 2015 07:37:35 -0800 (PST) In-Reply-To: References: From: Jean-Marc Spaggiari Date: Mon, 16 Feb 2015 10:37:35 -0500 Message-ID: Subject: Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is available. Please vote by Feb 19 2015 To: dev Content-Type: multipart/alternative; boundary=089e01229512d22a98050f365e8f X-Virus-Checked: Checked by ClamAV on apache.org --089e01229512d22a98050f365e8f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Download and un-packed passed. Checked Changes.txt =3D> Passed. Checked documentation =3D> Link "Why does HBase care about /etc/hosts? " in section "Quick Start - Standalone HBase" doesn't work Run test suite =3D> Failed 3 time in a row with JDK 1.7 Failed tests: TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90 expected: but was: TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90 expected: but was: TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90 expected: but was: Tried with JDK8 and got a lot of: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=3D256m; support was removed in 8.0 And the same errors + some others, ran it twice, twice the same errors. Same as with JDK1.7 + the SSL one. Failed tests: TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90 expected: but was: TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90 expected: but was: TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90 expected: but was: Tests in error: org.apache.hadoop.hbase.http.TestSSLHttpServer.org.apache.hadoop.hbase.http= .TestSSLHttpServer Run 1: TestSSLHttpServer.setup:71 =C2=BB Certificate Subject class type invalid. Run 2: TestSSLHttpServer.cleanup:102 NullPointer Checked RAT =3D> Passed While running in standalone got this exception in the logs when clicking on Debug Dump in the master interface: 2015-02-16 10:19:39,172 ERROR [666059465@qtp-2106900153-3] mortbay.log: /dump java.lang.NullPointerException at org.apache.hadoop.hbase.regionserver.RSDumpServlet.dumpQueue(RSDumpServlet.= java:106) at org.apache.hadoop.hbase.master.MasterDumpServlet.doGet(MasterDumpServlet.ja= va:105) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle= r.java:1221) at org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFil= ter(StaticUserWebFilter.java:113) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle= r.java:1212) at org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpSer= ver.java:1351) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle= r.java:1212) at org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle= r.java:1212) at org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandle= r.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450= ) at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCol= lection.java:230) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnecti= on.java:928) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410= ) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:58= 2) Ran some create table, puts, alter, get, scans from command line =3D> Passe= d. I'm also running PE on another cluster, but I'm not happy with the way it runs. Not related to HBase, more related to PE itself. Might move to YCSB or open some JIRAs. Did a rolling restart from 1.0.0 to 1.0.0. =3D> Passed. Overall, all seems to be working fine, but not sure about the tests failures and the dump exception. 0 for me. Because of the SSL issue with JDK 8 I'm not sure of the impact on a secured cluster. Also, has not been able to get any successful run of the tests and I have not been able to validate the performances. JM 2015-02-16 8:00 GMT-05:00 Jean-Marc Spaggiari : > Hi Enis, > > Quick question, how do you validate the signature? Seems to be a > compressed format, not sure if there is a specific command to validate it= . > > Thanks, > > JM > > 2015-02-15 0:55 GMT-05:00 Enis S=C3=B6ztutar : > > It gives me great pleasure to announce that the sixth release candidate f= or >> the release >> 1.0.0 (HBase-1.0.0RC5), is available for download at >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/ >> >> Maven artifacts are also available in the temporary repository >> https://repository.apache.org/content/repositories/orgapachehbase-1065 >> >> Signed with my code signing key E964B5FF. Can be found here: >> https://people.apache.org/keys/committer/enis.asc >> >> Signed tag in the repository can be found here: >> >> https://git-wip-us.apache.org/repos/asf?p=3Dhbase.git;a=3Dtag;h=3Dc46609= 12e9b46c917a9aba2106be4bf74182a764 >> >> HBase 1.0.0 is the next stable release, and the start of "semantic >> versioned" >> releases (See [1]). >> >> The theme of 1.0.0 release is to become a stable base for future 1.x >> series >> of releases. We aim to achieve at least the same level of stability of >> 0.98 >> releases. >> >> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with >> the >> previous 0.99.x releases, major changes in 1.0.0 are listed (but not >> limited to) >> below. Note that all previous 0.99.x releases are developer preview >> releases, and will >> NOT be supported in any form. >> >> API Cleanup and changes >> 1.0.0 introduces new APIs, and deprecates some of commonly-used >> client side APIs (HTableInterface, HTable and HBaseAdmin). >> We advise to update your application to use the new style of APIs, sin= ce >> deprecated APIs might be removed in future releases (2.x). See [2] and >> [3] >> for an overview of changes. All Client side API's are marked with >> InterfaceAudience.Public class, indicating that the class/method is an >> official "client API" for HBase. All 1.x releases are planned to be AP= I >> compatible for these classes. See [1] for an overview. >> >> Master runs a Region Server as well >> Starting with 1.0.0, the HBase master server and backup master servers >> will >> also act as a region server. RPC port and info port for web UI is shar= ed >> for >> the master and region server roles. Active master can host regions of >> defined tables if configured (disabled by default). Backup masters wil= l >> not >> host regions. >> >> Read availability using timeline consistent region replicas >> This release contains Phase 1 items for experimental "Read availabilit= y >> using >> timeline consistent region replicas" feature. A region can be hosted i= n >> multiple region servers in read-only mode. One of the replicas for the >> region >> will be primary, accepting writes, and other replicas will be sharing >> the >> same >> data files. Read requests can be done against any replica for the regi= on >> with >> backup RPCs for high availability with timeline consistency guarantees= . >> More >> information can be found at HBASE-10070. >> >> Online config change and other forward ports from 0.89-fb branch >> HBASE-12147 forward ported online config change which enables some of >> the >> configuration from the server to be reloaded without restarting the >> region >> servers. >> >> Other notable improvements in 1.0.0 (including previous 0.99.x) are >> - A new web skin in time for 1.0 (http://hbase.apache.org) >> - Automatic tuning of global memstore and block cache sizes >> - Various security, tags and visibility labels improvements >> - Bucket cache improvements (usability and compressed data blocks) >> - A new pluggable replication endpoint to plug in to HBase's >> inter-cluster >> replication to replicate to a custom data store >> - A Dockerfile to easily build and run HBase from source >> - Truncate table command >> - Region assignment to use hbase:meta table instead of zookeeper for >> faster >> region assignment (disabled by default) >> - Extensive documentation improvements >> - [HBASE-12511] - namespace permissions - add support from table creati= on >> privilege in a namespace 'C' >> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book >> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift >> Server >> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with onlin= e >> configuration capability' to branch-1 >> - [HBASE-10560] - Per cell TTLs >> - [HBASE-11997] - CopyTable with bulkload >> - [HBASE-11990] - Make setting the start and stop row for a specific >> prefix easier >> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics >> - [HBASE-12090] - Bytes: more Unsafe, more Faster >> - [HBASE-12032] - Script to stop regionservers via RPC >> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.rege= x >> in RegexStringComparator >> - [HBASE-11796] - Add client support for atomic checkAndMutate >> - [HBASE-11804] - Raise default heap size if unspecified >> - [HBASE-11890] - HBase REST Client is hard coded to http protocol >> - [HBASE-12126] - Region server coprocessor endpoint >> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans >> - [HBASE-12075] - Preemptive Fast Fail >> - [HBASE-12354] - Update dependencies in time for 1.0 release >> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSION= S >> - [HBASE-12434] - Add a command to compact all the regions in a >> regionserver >> - [HBASE-8707] - Add LongComparator for filter >> - [HBASE-12286] - [shell] Add server/cluster online load of configurati= on >> changes >> - [HBASE-12361] - Show data locality of region in table page >> - [HBASE-12496] - A blockedRequestsCount metric >> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) >> to >> branch-1 >> - [HBASE-12731] - Heap occupancy based client pushback >> - [HBASE-12728] - buffered writes substantially less useful after remov= al >> of HTablePool >> - [HBASE-5699] - Run with > 1 WAL in HRegionServer >> - Various fixes to REST server >> - Internal refactoring for abstracting away zookeeper usage >> - Better support for Cell interface internally in read and write paths >> for >> better performance and flexibility >> - Combining internal mvcc and seqId infrastructure >> - Ring buffer based WAL improvements >> - Switch to using new style of client APIs internally (in a lot of >> places) >> - Improvements in visibility labels >> - Perf improvements >> - Numerous improvements in other areas and bug fixes. >> >> 1.0.0 release has these changes in default behavior (see [4]) >> - Zookeeper 3.4.x is required >> - Hadoop-2.x is required >> - JDK-1.7 is required >> - Default ports have changed from 600XX range into out of ephemeral 160= XX >> range. >> - Hfile version 3 has been enabled by default. >> - Slab cache has been removed (use bucket cache instead) >> - Default heap for region servers (and master) is changed from 1GB to >> the jdk's default. On most platforms, it will default to 1/4 of >> physical >> memory >> - Some client facing APIs (HTableInterface, etc) has been deprecated an= d >> replaced. >> - Custom Filter implementations should switch to using the new >> recommended >> APIs. >> - Some authorization permissions (especially regarding namespaces) have >> been >> changed (HBASE-12511, HBASE-8015) >> - Mapred package and classes under there has been un-deprecated. >> - Two new modules (jar files): hbase-annotations and hbase-rest. >> - HTrace dependency is moved to the Apache artifacts ( >> https://htrace.incubator.apache.org/) >> - Various updates to dependency versions >> >> Full list of the issues can be found at: >> - 1.0.0 issues : >> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=3D12310= 753&version=3D12325852 >> - 0.99.2 issues : >> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=3D12310= 753&version=3D12325675 >> - 0.99.1 issues : >> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=3D12310= 753&version=3D12328551 >> - 0.99.0 issues : >> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=3D12310= 753&version=3D12328822 >> >> Compatibility >> ------------- >> Source Compatibility: >> Client side code in HBase-1.0.0 is (mostly) source compatible with earli= er >> versions. Some minor API changes might be needed from the client side. >> >> >> Wire Compatibility: >> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and >> servers running in different versions as long as new features are not us= ed >> should be possible. >> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. >> 1.0.0 >> introduces a new file format (hfile v3) that is enabled by default that >> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0= .0 >> is >> not supported. >> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc). >> >> Binary Compatibility: >> Binary compatibility at the Java API layer with earlier versions (0.98.x= , >> 0.96.x and 0.94.x) is not supported. You may have to recompile your clie= nt >> code and any server side code (coprocessors, filters etc) referring to >> hbase jars. >> >> Upgrading >> --------- >> See [4] for upgrade instructions and extended discussion on the changes. >> >> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade >> fashion >> is supported. >> >> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and resta= rt >> of >> the cluster. >> >> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from >> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level >> metadata. >> See [5] for details. >> >> >> Supported Hadoop versions >> ------------------------- >> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x >> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x >> releases >> are the most tested hadoop releases and we recommend running with those >> versions >> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and >> 2.3.x) >> are not tested to the full extend. More information can be found here: >> https://hbase.apache.org/book/configuration.html#hadoop >> >> >> Supported Java versions >> ------------------------- >> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 suppo= rt >> is experimental. More information can be found here: >> https://hbase.apache.org/book/configuration.html#java >> >> >> Voting >> ------ >> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT. >> We will have a 5 day voting period because this is the sixth RC. Please >> try >> to >> spend some time for testing this important release. >> >> [] +1 Release the artifacts as 1.0.0 >> [] -1 DO NOT release the artifacts as 1.0.0, because... >> >> Gratitute >> --------- >> Last but not least, 1.0.0 release has been in a long time making with >> contributions from a very large group of awesome people and hard work fr= om >> committers and contributors. We would like to extend our thanks to >> everybody >> who worked on this release or contributed to HBase over the years. >> >> >> References >> ---------- >> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning >> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release >> [3] http://s.apache.org/hbase-1.0-api >> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes >> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94 >> >> Enis >> > > --089e01229512d22a98050f365e8f--