Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com
 designates 209.85.217.172 as permitted sender)
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: 
 <CAMUu0w9q=9ey4OgW7EXD-czj4Z+GV=zuC8vkEhfD-XVnJTg=yA@mail.gmail.com>
References: 
 <CAMUu0w8jcTEZ-f8Dvu9sUujgHB1t1YZMiHTMtPTfGEnR7nht2g@mail.gmail.com>
	<CAMUu0w-i-Z0nV0vou-9mxEXfnoB_HF9Eegm5ZMmmsCKgyRV0tQ@mail.gmail.com>
	<CALte62zDqWbwB7tihJuMcp_Z_dBkCAmpo+nzmaY-zgc+-tZ9gQ@mail.gmail.com>
	<CAMUu0w9q=9ey4OgW7EXD-czj4Z+GV=zuC8vkEhfD-XVnJTg=yA@mail.gmail.com>
Date: Sun, 29 Jun 2014 10:25:08 -0700
Message-ID: 
 <CADcMMgFR461DBtAXZ+GuikYuvFq2Hp2wvPdpsWhpajHSHr=nzw@mail.gmail.com>
Subject: Re: [NOTICE] No checkins to master for 1-2 hours please
From: Stack <stack@duboce.net>
To: HBase Dev List <dev@hbase.apache.org>
Content-Type: multipart/alternative; boundary=047d7b34385afa11ca04fcfcd2ea

--047d7b34385afa11ca04fcfcd2ea
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Nice work Enis.
St.Ack


On Fri, Jun 27, 2014 at 7:32 PM, Enis S=C3=B6ztutar <enis@apache.org> wrote=
:

> Update:
>
> I've completed the merge for branch hbase-10070 to master now. As a short
> reminder the committed changes include phase 1 work for the new feature
> called "read high availability using timeline consistent reads with regio=
n
> replicas". Some more context can be found in [1] and vote thread here [2]=
.
>
> The merge contains 44 commits in total as follows. I've uploaded the
> committed patches to relevant jiras, and set the fix versions for the jir=
as
> as well (using git format-patch and the excellent jira-cli client).
>
> Applying: HBASE-10347 HRegionInfo changes for adding replicaId and
> MetaEditor/MetaReader changes for region replicas
> Applying: HBASE-10354 Add an API for defining consistency per request
> Applying: HBASE-10348. HTableDescriptor changes for region replicas
> Applying: HBASE-10517 NPE in MetaCache.clearCache()
> Applying: HBASE-10354. Addendum commit. 10354.add.patch committed
> Applying: HBASE-10356 Failover RPC's for multi-get
> Applying: HBASE-10350. Master/AM/RegionStates changes to create and assig=
n
> region replicas (ddas)
> Applying: HBASE-10359 Master/RS WebUI changes for region replicas
> Applying: HBASE-10361. Enable/AlterTable support for region replicas (dda=
s)
> Applying: HBASE-10352 Region and RegionServer changes for opening region
> replicas, and refreshing store files
> Applying: HBASE-10362. HBCK changes for supporting region replicas
> Applying: HBASE-10351 LoadBalancer changes for supporting region replicas
> Applying: HBASE-10630 NullPointerException in
> ConnectionManager$HConnectionImplementation.locateRegionInMeta() due to
> missing region info
> Applying: HBASE-10633. StoreFileRefresherChore throws
> ConcurrentModificationException sometimes
> Applying: HBASE-10672. Table snapshot should handle tables whose
> REGION_REPLICATION is greater than one
> Applying: HBASE-10620. LoadBalancer.needsBalance() should check for
> co-located region replicas as well
> Applying: HBASE-10355 Failover RPC's from client using region replicas
> Applying: HBASE-10704 BaseLoadBalancer#roundRobinAssignment() may add sam=
e
> region to assignment plan multiple times
> Applying: HBASE-10572 Create an IntegrationTest for region replicas
> Applying: HBASE-10729. Enable table doesn't balance out replicas evenly i=
f
> the replicas were unassigned earlier
> Applying: HBASE-10620 LoadBalancer.needsBalance() should check for
> co-located region replicas as well (Addendum patch to fix return value fr=
om
> balance() call)
> Applying: HBASE-10734. Fix RegionStates.getRegionAssignments to not add
> duplicate regions
> Applying: HBASE-10616. Integration test for multi-get calls
> Applying: HBASE-10743. Replica map update is problematic in RegionStates
> Applying: HBASE-10616. Addendum that fixes the case of multiget_batchsize
> =3D=3D 1
> Applying: HBASE-10778 Unique keys accounting in MultiThreadedReader is
> incorrect
> Applying: HBASE-10858 TestRegionRebalancing is failing
> Applying: HBASE-10817 Add some tests on a real cluster for replica: multi
> master, replication
> Applying: HBASE-10701 Cache invalidation improvements from client side
> Applying: HBASE-10859 Use HFileLink in opening region files from
> secondaries
> Applying: HBASE-10791 Add integration test to demonstrate performance
> improvement
> Applying: HBASE-10634 Multiget doesn't fully work
> Applying: HBASE-10794 multi-get should handle replica location missing fr=
om
> cache
> Applying: HBASE-10785 Metas own location should be cached
> Applying: HBASE-10957 HMaster can abort with NPE in #rebuildUserRegions
> (Nicolas Liochon)
> Applying: HBASE-10661
> TestStochasticLoadBalancer.testRegionReplicationOnMidClusterWithRacks() i=
s
> flaky
> Applying: HBASE-10513 Provide user documentation for region replicas
> Applying: HBASE-10810 LoadTestTool should share the connection and
> connection pool
> Applying: HBASE-10357 Failover RPC's for scans (Devaraj Das)
> Applying: HBASE-11214. Fixes for scans on a replicated table
> Applying: HBASE-10818. Add integration test for bulkload with replicas
> (Nick Dimiduk and Devaraj Das)
> Applying: HBASE-10818. Addendum to reduce the number of times sleep happe=
ns
> in the coprocessor. Also, puts back code to set consistency that got
> deleted by accident in the last commit.
> Applying: HBASE-11332 Fix for metas location cache from HBASE-10785
> Applying: Increase -XX:MaxPermSize for unit tests
>
>
> Unit tests should be working now, but in case it fails on the apache infr=
a,
> I'll take a closer look at the jenkins build at
> https://builds.apache.org/view/All/job/HBase-TRUNK/. We've been running
> the
> integration tests as well but ideally we want to spend some more time on
> perf regression analysis and long tail latency improvements. We can iron
> out the edges in time. Nicolas has already been doing work around this.
>
> Let me know if you see any issues related to this merge.
>
>
> [1]
> https://mail-archives.apache.org/mod_mbox/hbase-dev/201405.mbox/browser
> [2]
>
> https://mail-archives.apache.org/mod_mbox/hbase-dev/201406.mbox/%3CCAMUu0=
w8uvb29%2BQYpZ8VwSO4qEpKRyKGNPzyj1kw7tLRhLPoZkA%40mail.gmail.com%3E
>
>
>
>
> On Fri, Jun 27, 2014 at 7:03 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > Good job.
> >
> >
> > On Fri, Jun 27, 2014 at 5:45 PM, Enis S=C3=B6ztutar <enis@apache.org> w=
rote:
> >
> > > Pushed the rebased branch. You can go crazy on the master now.
> > >
> > > Enis
> > >
> > >
> > > On Fri, Jun 27, 2014 at 4:37 PM, Enis S=C3=B6ztutar <enis@apache.org>
> wrote:
> > >
> > > > Hi,
> > > >
> > > > I am merging the hbase-10070 branch to master. No checkins please.
> > > >
> > > > We were able to get unit tests working, and IT's working. There may
> be
> > a
> > > > couple of edge cases after rebase, but we can resolve them in maste=
r.
> > > >
> > > > I'll send a detailed update once done.
> > > >
> > > > Enis
> > > >
> > >
> >
>

--047d7b34385afa11ca04fcfcd2ea--