hbase-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zhang...@apache.org
Subject [hbase] branch branch-2.1 updated: HBASE-21819 Generate CHANGES.md and RELEASENOTES.md for 2.1.3
Date Mon, 04 Feb 2019 01:25:01 GMT
This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/branch-2.1 by this push:
     new 40a369e  HBASE-21819 Generate CHANGES.md and RELEASENOTES.md for 2.1.3
40a369e is described below

commit 40a369ed8401d9d42b7bbcc114b7d511456c2843
Author: zhangduo <zhangduo@apache.org>
AuthorDate: Mon Feb 4 09:18:51 2019 +0800

    HBASE-21819 Generate CHANGES.md and RELEASENOTES.md for 2.1.3
---
 CHANGES.md      | 87 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++
 RELEASENOTES.md | 86 ++++++++++++++++++++++++++++++++++++++++++++++++++++++--
 2 files changed, 171 insertions(+), 2 deletions(-)

diff --git a/CHANGES.md b/CHANGES.md
index 77bb3c0..cf89366 100755
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -18,6 +18,90 @@
 # limitations under the License.
 -->
 
+## Release 2.1.3 - Unreleased (as of 2019-02-04)
+
+### INCOMPATIBLE CHANGES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-21684](https://issues.apache.org/jira/browse/HBASE-21684) | Throw DNRIOE when connection
or rpc client is closed |  Major | asyncclient, Client |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-21833](https://issues.apache.org/jira/browse/HBASE-21833) | Use NettyAsyncFSWALConfigHelper.setEventLoopConfig
to prevent creating too many netty event loop when executing TestHRegion |  Minor | test |
+| [HBASE-21634](https://issues.apache.org/jira/browse/HBASE-21634) | Print error message
when user uses unacceptable values for LIMIT while setting quotas. |  Minor | . |
+| [HBASE-21712](https://issues.apache.org/jira/browse/HBASE-21712) | Make submit-patch.py
python3 compatible |  Minor | tooling |
+| [HBASE-21590](https://issues.apache.org/jira/browse/HBASE-21590) | Optimize trySkipToNextColumn
in StoreScanner a bit |  Critical | Performance, Scanners |
+| [HBASE-21297](https://issues.apache.org/jira/browse/HBASE-21297) | ModifyTableProcedure
can throw TNDE instead of IOE in case of REGION\_REPLICATION change |  Minor | . |
+| [HBASE-21694](https://issues.apache.org/jira/browse/HBASE-21694) | Add append\_peer\_exclude\_tableCFs
and remove\_peer\_exclude\_tableCFs shell commands |  Major | . |
+| [HBASE-21645](https://issues.apache.org/jira/browse/HBASE-21645) | Perform sanity check
and disallow table creation/modification with region replication \< 1 |  Minor | . |
+| [HBASE-21662](https://issues.apache.org/jira/browse/HBASE-21662) | Add append\_peer\_exclude\_namespaces
and remove\_peer\_exclude\_namespaces shell commands |  Major | . |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-21644](https://issues.apache.org/jira/browse/HBASE-21644) | Modify table procedure
runs infinitely for a table having region replication \> 1 |  Critical | Admin |
+| [HBASE-21775](https://issues.apache.org/jira/browse/HBASE-21775) | The BufferedMutator
doesn't ever refresh region location cache |  Major | Client |
+| [HBASE-21699](https://issues.apache.org/jira/browse/HBASE-21699) | Create table failed
when using  SPLITS\_FILE =\> 'splits.txt' |  Blocker | Client, shell |
+| [HBASE-21535](https://issues.apache.org/jira/browse/HBASE-21535) | Zombie Master detector
is not working |  Critical | master |
+| [HBASE-21754](https://issues.apache.org/jira/browse/HBASE-21754) | ReportRegionStateTransitionRequest
should be executed in priority executor |  Major | . |
+| [HBASE-21475](https://issues.apache.org/jira/browse/HBASE-21475) | Put mutation (having
TTL set) added via co-processor is retrieved even after TTL expires |  Major | Coprocessors
|
+| [HBASE-21749](https://issues.apache.org/jira/browse/HBASE-21749) | RS UI may throw NPE
and make rs-status page inaccessible with multiwal and replication |  Major | Replication,
UI |
+| [HBASE-21746](https://issues.apache.org/jira/browse/HBASE-21746) | Fix two concern cases
in RegionMover |  Major | . |
+| [HBASE-21732](https://issues.apache.org/jira/browse/HBASE-21732) | Should call toUpperCase
before using Enum.valueOf in some methods for ColumnFamilyDescriptor |  Critical | Client
|
+| [HBASE-21704](https://issues.apache.org/jira/browse/HBASE-21704) | The implementation of
DistributedHBaseCluster.getServerHoldingRegion is incorrect |  Major | . |
+| [HBASE-20917](https://issues.apache.org/jira/browse/HBASE-20917) | MetaTableMetrics#stop
references uninitialized requestsMap for non-meta region |  Major | meta, metrics |
+| [HBASE-21639](https://issues.apache.org/jira/browse/HBASE-21639) | maxHeapUsage value not
read properly from config during EntryBuffers initialization |  Minor | . |
+| [HBASE-21225](https://issues.apache.org/jira/browse/HBASE-21225) | Having RPC & Space
quota on a table/Namespace doesn't allow space quota to be removed using 'NONE' |  Major |
. |
+| [HBASE-20220](https://issues.apache.org/jira/browse/HBASE-20220) | [RSGroup] Check if table
exists in the cluster before moving it to the specified regionserver group |  Major | rsgroup
|
+| [HBASE-21691](https://issues.apache.org/jira/browse/HBASE-21691) | Fix flaky test TestRecoveredEdits
|  Major | . |
+| [HBASE-21683](https://issues.apache.org/jira/browse/HBASE-21683) | Reset readsEnabled flag
after successfully flushing the primary region |  Critical | read replicas |
+| [HBASE-21630](https://issues.apache.org/jira/browse/HBASE-21630) | [shell] Define ENDKEY
== STOPROW (we have ENDROW) |  Trivial | shell |
+| [HBASE-21547](https://issues.apache.org/jira/browse/HBASE-21547) | Precommit uses master
flaky list for other branches |  Major | test |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-21834](https://issues.apache.org/jira/browse/HBASE-21834) | Set version as 2.1.3
in branch-2.1 in prep for first RC |  Major | build, release |
+| [HBASE-21829](https://issues.apache.org/jira/browse/HBASE-21829) | Use FutureUtils.addListener
instead of calling whenComplete directly |  Major | asyncclient, Client |
+| [HBASE-21832](https://issues.apache.org/jira/browse/HBASE-21832) | Backport parent "HBASE-21595
Print thread's information and stack traces when RS is aborting forcibly" to branch-2.0/2.1
|  Minor | regionserver |
+| [HBASE-21828](https://issues.apache.org/jira/browse/HBASE-21828) | Make sure we do not
return CompletionException when locating region |  Major | asyncclient, Client |
+| [HBASE-21764](https://issues.apache.org/jira/browse/HBASE-21764) | Size of in-memory compaction
thread pool should be configurable |  Major | in-memory-compaction |
+| [HBASE-21402](https://issues.apache.org/jira/browse/HBASE-21402) | Backport parent "HBASE-21325
Force to terminate regionserver when abort hang in somewhere" |  Major | . |
+| [HBASE-21734](https://issues.apache.org/jira/browse/HBASE-21734) | Some optimization in
FilterListWithOR |  Major | . |
+| [HBASE-21738](https://issues.apache.org/jira/browse/HBASE-21738) | Remove all the CSLM#size
operation in our memstore because it's an quite time consuming. |  Critical | Performance
|
+| [HBASE-19695](https://issues.apache.org/jira/browse/HBASE-19695) | Handle disabled table
for async client |  Major | asyncclient, Client |
+| [HBASE-21727](https://issues.apache.org/jira/browse/HBASE-21727) | Simplify documentation
around client timeout |  Minor | . |
+| [HBASE-21711](https://issues.apache.org/jira/browse/HBASE-21711) | Remove references to
git.apache.org/hbase.git |  Critical | . |
+| [HBASE-19722](https://issues.apache.org/jira/browse/HBASE-19722) | Meta query statistics
metrics source |  Critical | Coprocessors, meta, metrics, Operability |
+| [HBASE-21705](https://issues.apache.org/jira/browse/HBASE-21705) | Should treat meta table
specially for some methods in AsyncAdmin |  Major | Admin, asyncclient, Client |
+| [HBASE-21663](https://issues.apache.org/jira/browse/HBASE-21663) | Add replica scan support
|  Major | asyncclient, Client, read replicas |
+| [HBASE-21580](https://issues.apache.org/jira/browse/HBASE-21580) | Support getting Hbck
instance from AsyncConnection |  Major | asyncclient, Client, hbck2 |
+| [HBASE-21698](https://issues.apache.org/jira/browse/HBASE-21698) | Move version in branch-2.1
from 2.1.2 to 2.1.3-SNAPSHOT |  Major | release |
+| [HBASE-21682](https://issues.apache.org/jira/browse/HBASE-21682) | Support getting from
specific replica |  Major | read replicas |
+| [HBASE-17356](https://issues.apache.org/jira/browse/HBASE-17356) | Add replica get support
|  Major | Client |
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-21612](https://issues.apache.org/jira/browse/HBASE-21612) | Add developer debug
options in  HBase Config for REST server |  Minor | Operability, REST, scripts |
+| [HBASE-21791](https://issues.apache.org/jira/browse/HBASE-21791) | Upgrade thrift dependency
to 0.12.0 |  Blocker | Thrift |
+| [HBASE-21715](https://issues.apache.org/jira/browse/HBASE-21715) | Do not throw UnsupportedOperationException
in ProcedureFuture.get |  Major | Client |
+| [HBASE-21731](https://issues.apache.org/jira/browse/HBASE-21731) | Do not need to use ClusterConnection
in IntegrationTestBigLinkedListWithVisibility |  Major | . |
+| [HBASE-21685](https://issues.apache.org/jira/browse/HBASE-21685) | Change repository urls
to Gitbox |  Critical | . |
+| [HBASE-21282](https://issues.apache.org/jira/browse/HBASE-21282) | Upgrade to latest jetty
9.2 and 9.3 versions |  Major | dependencies |
+
+
+
 ## Release 2.1.2 - Unreleased (as of 2018-12-29)
 
 
@@ -33,6 +117,7 @@
 | [HBASE-21590](https://issues.apache.org/jira/browse/HBASE-21590) | Optimize trySkipToNextColumn
in StoreScanner a bit |  Critical | Performance, Scanners |
 | [HBASE-21554](https://issues.apache.org/jira/browse/HBASE-21554) | Show replication endpoint
classname for replication peer on master web UI |  Minor | UI |
 | [HBASE-21549](https://issues.apache.org/jira/browse/HBASE-21549) | Add shell command for
serial replication peer |  Major | . |
+| [HBASE-21567](https://issues.apache.org/jira/browse/HBASE-21567) | Allow overriding configs
starting up the shell |  Major | shell |
 | [HBASE-21413](https://issues.apache.org/jira/browse/HBASE-21413) | Empty meta log doesn't
get split when restart whole cluster |  Major | . |
 | [HBASE-21524](https://issues.apache.org/jira/browse/HBASE-21524) | Unnecessary DEBUG log
in ConnectionImplementation#isTableEnabled |  Major | Client |
 | [HBASE-21511](https://issues.apache.org/jira/browse/HBASE-21511) | Remove in progress snapshot
check in SnapshotFileCache#getUnreferencedFiles |  Minor | . |
@@ -57,6 +142,7 @@
 | [HBASE-21589](https://issues.apache.org/jira/browse/HBASE-21589) | TestCleanupMetaWAL fails
|  Blocker | test, wal |
 | [HBASE-21582](https://issues.apache.org/jira/browse/HBASE-21582) | If call HBaseAdmin#snapshotAsync
but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time
|  Major | . |
 | [HBASE-21568](https://issues.apache.org/jira/browse/HBASE-21568) | Disable use of BlockCache
for LoadIncrementalHFiles |  Major | Client |
+| [HBASE-21453](https://issues.apache.org/jira/browse/HBASE-21453) | Convert ReadOnlyZKClient
to DEBUG instead of INFO |  Major | logging, Zookeeper |
 | [HBASE-21559](https://issues.apache.org/jira/browse/HBASE-21559) | The RestoreSnapshotFromClientTestBase
related UT are flaky |  Major | . |
 | [HBASE-21551](https://issues.apache.org/jira/browse/HBASE-21551) | Memory leak when use
scan with STREAM at server side |  Blocker | regionserver |
 | [HBASE-21479](https://issues.apache.org/jira/browse/HBASE-21479) | Individual tests in
TestHRegionReplayEvents class are failing |  Major | . |
@@ -96,6 +182,7 @@
 | JIRA | Summary | Priority | Component |
 |:---- |:---- | :--- |:---- |
 | [HBASE-21401](https://issues.apache.org/jira/browse/HBASE-21401) | Sanity check when constructing
the KeyValue |  Critical | regionserver |
+| [HBASE-21570](https://issues.apache.org/jira/browse/HBASE-21570) | Add write buffer periodic
flush support for AsyncBufferedMutator |  Major | asyncclient, Client |
 | [HBASE-21566](https://issues.apache.org/jira/browse/HBASE-21566) | Release notes and changes
for 2.0.4RC0 and 2.1.2RC0 |  Major | release |
 | [HBASE-21490](https://issues.apache.org/jira/browse/HBASE-21490) | WALProcedure may remove
proc wal files still with active procedures |  Major | proc-v2 |
 | [HBASE-21377](https://issues.apache.org/jira/browse/HBASE-21377) | Add debug log for procedure
stack id related operations |  Major | proc-v2 |
diff --git a/RELEASENOTES.md b/RELEASENOTES.md
index 5c50041..9ca08b5 100755
--- a/RELEASENOTES.md
+++ b/RELEASENOTES.md
@@ -1,5 +1,3 @@
-# HBASE  2.1.2 Release Notes
-
 <!---
 # Licensed to the Apache Software Foundation (ASF) under one
 # or more contributor license agreements.  See the NOTICE file
@@ -17,8 +15,72 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 -->
+# HBASE  2.1.3 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities, important issues,
features, and major improvements.
+
+
+---
+
+* [HBASE-21764](https://issues.apache.org/jira/browse/HBASE-21764) | *Major* | **Size of
in-memory compaction thread pool should be configurable**
+
+Introduced an new config key in this issue: hbase.regionserver.inmemory.compaction.pool.size.
the default value would be 10.  you can configure this to set the pool size of in-memory compaction
pool. Note that all memstores in one region server will share the same pool, so if you have
many regions in one region server,  you need to set this larger to compact faster for better
read performance.
+
+
+---
+
+* [HBASE-21684](https://issues.apache.org/jira/browse/HBASE-21684) | *Major* | **Throw DNRIOE
when connection or rpc client is closed**
+
+Make StoppedRpcClientException extend DoNotRetryIOException.
+
+
+---
+
+* [HBASE-21791](https://issues.apache.org/jira/browse/HBASE-21791) | *Blocker* | **Upgrade
thrift dependency to 0.12.0**
+
+IMPORTANT: Due to security issues, all users who use hbase thrift should avoid using releases
which do not have this fix.
+
+The effect releases are:
+2.1.x: 2.1.2 and below
+2.0.x: 2.0.4 and below
+1.x: 1.4.x and below
+
+If you are using the effect releases above, please consider upgrading to a newer release
ASAP.
+
+
+---
+
+* [HBASE-21734](https://issues.apache.org/jira/browse/HBASE-21734) | *Major* | **Some optimization
in FilterListWithOR**
+
+After HBASE-21620, the filterListWithOR has been a bit slow because we need to merge each
sub-filter's RC , while before HBASE-21620, we will skip many RC merging, but the logic was
wrong. So here we choose another way to optimaze the performance: removing the KeyValueUtil#toNewKeyCell.
+Anoop Sam John suggested that the KeyValueUtil#toNewKeyCell can save some GC before because
if we copy key part of cell into a single byte[], then the block the cell refering won't be
refered by the filter list any more, the upper layer can GC the data block quickly. while
after HBASE-21620, we will update the prevCellList for every encountered cell now, so the
lifecycle of cell in prevCellList for FilterList will be quite shorter. so just use the cell
ref for saving cpu.
+BTW, we removed all the arrays streams usage in filter list, because it's also quite time-consuming
in our test.
+
+
+---
+
+* [HBASE-21738](https://issues.apache.org/jira/browse/HBASE-21738) | *Critical* | **Remove
all the CSLM#size operation in our memstore because it's an quite time consuming.**
+
+We found the memstore snapshotting would cost much time because of calling the time-consuming
ConcurrentSkipListMap#Size, it would make the p999 latency spike happen. So in this issue,
we remove all ConcurrentSkipListMap#size in memstore by counting the cellsCount in MemstoreSizeing.
As the issue described, the p999 latency spike was mitigated.
+
+
+---
+
+* [HBASE-21732](https://issues.apache.org/jira/browse/HBASE-21732) | *Critical* | **Should
call toUpperCase before using Enum.valueOf in some methods for ColumnFamilyDescriptor**
+
+Now all the Enum configs in ColumnFamilyDescriptor can accept lower case config value.
+
+
+---
+
+* [HBASE-21712](https://issues.apache.org/jira/browse/HBASE-21712) | *Minor* | **Make submit-patch.py
python3 compatible**
+
+Python3 support was added to dev-support/submit-patch.py. To install newly required dependencies
run \`pip install -r dev-support/python-requirements.txt\` command.
 
 
+
+# HBASE  2.1.2 Release Notes
+
 These release notes cover new developer and user-facing incompatibilities, important issues,
features, and major improvements.
 
 
@@ -49,6 +111,26 @@ The replication UI on master will show the replication endpoint classname.
 
 Add a SERIAL flag for add\_peer command to identifiy whether or not the replication peer
is a serial replication peer. The default serial flag is false.
 
+---
+
+* [HBASE-21453](https://issues.apache.org/jira/browse/HBASE-21453) | *Major* | **Convert
ReadOnlyZKClient to DEBUG instead of INFO**
+
+Log level of ReadOnlyZKClient moved to debug.
+
+
+---
+
+* [HBASE-21567](https://issues.apache.org/jira/browse/HBASE-21567) | *Major* | **Allow overriding
configs starting up the shell**
+
+Allow passing of -Dkey=value option to shell to override hbase-\* configuration: e.g.:
+
+$ ./bin/hbase shell -Dhbase.zookeeper.quorum=ZK0.remote.cluster.example.org,ZK1.remote.cluster.example.org,ZK2.remote.cluster.example.org
-Draining=false
+...
+hbase(main):001:0\> @shell.hbase.configuration.get("hbase.zookeeper.quorum")
+=\> "ZK0.remote.cluster.example.org,ZK1.remote.cluster.example.org,ZK2.remote.cluster.example.org"
+hbase(main):002:0\> @shell.hbase.configuration.get("raining")
+=\> "false"
+
 
 ---
 


Mime
View raw message