Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
MIME-Version: 1.0
References: <CAEgSVcBZauBihM8ZQf3+mGy=B7U2ACTJ_pZiVwTNYdMuDn9GGg@mail.gmail.com>
 <pony-51ef25fd0a3611d18ffb478ae2ae610bbbd2432c-0ae27cc8743c440c52cf351c6ab5c512904a518e@dev.hbase.apache.org>
In-Reply-To: <pony-51ef25fd0a3611d18ffb478ae2ae610bbbd2432c-0ae27cc8743c440c52cf351c6ab5c512904a518e@dev.hbase.apache.org>
From: Mikhail Antonov <olorinbant@gmail.com>
Date: Mon, 04 Sep 2017 12:26:36 +0000
Message-ID: <CAHxLZBV0OXAhxZsZrop+EM+mNZoT6Ugw4h6qVW-xO_TsdqyY2A@mail.gmail.com>
Subject: Re: should we split the scan range into serveral segments when the
 scan range only located in a single region?
To: dev@hbase.apache.org
Content-Type: multipart/alternative; boundary="001a1144bfba6b859305585c394e"
archived-at: Mon, 04 Sep 2017 12:26:58 -0000

--001a1144bfba6b859305585c394e
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

I've filed https://issues.apache.org/jira/browse/HBASE-18090 some time ago
and attached draft patch to it. It's not complete as we need some deeper
changes in the way we open regions (see comments) but basic stuff works (I
ended up going the other route and didn't have bandwidth to finish that -
would be great if someone picked it up)

Mikhail

On Mon, Sep 4, 2017 at 11:13 AM Chia-Ping Tsai <chia7712@apache.org> wrote:

> That sounds good. There are some related issue. see
> https://issues.apache.org/jira/browse/HBASE-4914 and
> https://issues.apache.org/jira/browse/HBASE-4063.
>
> On 2017-09-04 15:06, libis <libisthanks@gmail.com> wrote:
> > Hi
> >
> > When TableInputFormat is used to source an HBase table in a MapReduce
> job,
> > its splitter will make a map task for each region of the table. However=
,
> in
> > some cases, the user=E2=80=99s scan range may locate in a single region=
,
> resulting
> > in there is  a only mapper. For example, the rowkey of the table is
> > =E2=80=98md5(userid) + timestamp=E2=80=99, once client want to scan the=
 data of a
> specified
> > user in the latest month with MR, it=E2=80=99s much possible that there=
 is only
> one
> > mapper working.
> >
> > In order to scan data in parallel if the user's scan range located in a
> > single region, should we split the scan range into serveral segments
> within
> > a region?
> >
> > Best,
> >
> > xinxin
> >
>
--=20
Thanks,
Michael Antonov

--001a1144bfba6b859305585c394e--