Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
MIME-Version: 1.0
In-Reply-To: <pony-51ef25fd0a3611d18ffb478ae2ae610bbbd2432c-5fbaebff0508b321362426865645422e3e726b74@dev.hbase.apache.org>
References: <CAEgSVcBZauBihM8ZQf3+mGy=B7U2ACTJ_pZiVwTNYdMuDn9GGg@mail.gmail.com>
 <pony-51ef25fd0a3611d18ffb478ae2ae610bbbd2432c-0ae27cc8743c440c52cf351c6ab5c512904a518e@dev.hbase.apache.org>
 <CAHxLZBV0OXAhxZsZrop+EM+mNZoT6Ugw4h6qVW-xO_TsdqyY2A@mail.gmail.com> <pony-51ef25fd0a3611d18ffb478ae2ae610bbbd2432c-5fbaebff0508b321362426865645422e3e726b74@dev.hbase.apache.org>
From: libis <libisthanks@gmail.com>
Date: Tue, 5 Sep 2017 09:53:14 +0800
Message-ID: <CAEgSVcDXJQ83Wo=y_ZH4NHQCzExgTh3wLoaQSeYxrEC0owQQ9Q@mail.gmail.com>
Subject: Re: should we split the scan range into serveral segments when the
 scan range only located in a single region?
To: dev@hbase.apache.org
Content-Type: multipart/alternative; boundary="001a113eb6048fa1610558677dd7"
archived-at: Tue, 05 Sep 2017 01:53:24 -0000

--001a113eb6048fa1610558677dd7
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Thanks for Mikhail. I am pleasure to pick HBASE-18090 up (my jira account
is xinxin fan). i notice that the issue HBASE-16894(
https://issues.apache.org/jira/browse/HBASE-16894) tries to work on the
similar thing. Chia-Ping, look it?

2017-09-04 20:41 GMT+08:00 Chia-Ping Tsai <chia7712@apache.org>:

> Thanks for the information. Mikhail. It seems to me the issue is popular.
> libis, Could you take HBASE-18090 over? I can assign the issue to you if =
i
> get ur jira account.
>
> On 2017-09-04 20:26, Mikhail Antonov <olorinbant@gmail.com> wrote:
> > I've filed https://issues.apache.org/jira/browse/HBASE-18090 some time
> ago
> > and attached draft patch to it. It's not complete as we need some deepe=
r
> > changes in the way we open regions (see comments) but basic stuff works
> (I
> > ended up going the other route and didn't have bandwidth to finish that=
 -
> > would be great if someone picked it up)
> >
> > Mikhail
> >
> > On Mon, Sep 4, 2017 at 11:13 AM Chia-Ping Tsai <chia7712@apache.org>
> wrote:
> >
> > > That sounds good. There are some related issue. see
> > > https://issues.apache.org/jira/browse/HBASE-4914 and
> > > https://issues.apache.org/jira/browse/HBASE-4063.
> > >
> > > On 2017-09-04 15:06, libis <libisthanks@gmail.com> wrote:
> > > > Hi
> > > >
> > > > When TableInputFormat is used to source an HBase table in a MapRedu=
ce
> > > job,
> > > > its splitter will make a map task for each region of the table.
> However,
> > > in
> > > > some cases, the user=E2=80=99s scan range may locate in a single re=
gion,
> > > resulting
> > > > in there is  a only mapper. For example, the rowkey of the table is
> > > > =E2=80=98md5(userid) + timestamp=E2=80=99, once client want to scan=
 the data of a
> > > specified
> > > > user in the latest month with MR, it=E2=80=99s much possible that t=
here is
> only
> > > one
> > > > mapper working.
> > > >
> > > > In order to scan data in parallel if the user's scan range located
> in a
> > > > single region, should we split the scan range into serveral segment=
s
> > > within
> > > > a region?
> > > >
> > > > Best,
> > > >
> > > > xinxin
> > > >
> > >
> > --
> > Thanks,
> > Michael Antonov
> >
>

--001a113eb6048fa1610558677dd7--