Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of psybers@gmail.com designates
 209.85.213.171 as permitted sender)
MIME-Version: 1.0
Sender: psybers@gmail.com
In-Reply-To: 
 <CAGpTDNeP48u-MWfdes5J73jmSWdCidxnVieYfDczJgGoBs1BCg@mail.gmail.com>
References: 
 <CAMiz3FNEA--SQ3-VFEgx63DBin7CzHPUAiKTpyf_pTncyHA76w@mail.gmail.com>
	<CADcMMgGJe57hBNcw0rmz90FU3=NQUNA5q4TwgExvd1WA8jqa7Q@mail.gmail.com>
	<CAMiz3FOEnOQEzbs+MkEqwYmNC=pGzAME6tX8mb6FmtUhEGqeTg@mail.gmail.com>
	<CAGpTDNeP48u-MWfdes5J73jmSWdCidxnVieYfDczJgGoBs1BCg@mail.gmail.com>
Date: Mon, 17 Dec 2012 20:39:41 -0600
Message-ID: 
 <CAMiz3FPihnTq72J-8sziNQ57qyfrbFCS1bYvTY4iVrK30eGuLg@mail.gmail.com>
Subject: Re: Wrong input split locations after enabling reverse DNS
From: Robert Dyer <rdyer@iastate.edu>
To: Jean-Daniel Cryans <jdcryans@apache.org>
Cc: Hbase-User <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=20cf301af943f53c5304d1176892

--20cf301af943f53c5304d1176892
Content-Type: text/plain; charset=ISO-8859-1

Seems plausible.  A simple grep reveals this:

mapreduce/TableInputFormatBase.java:      hostName =
DNS.reverseDns(ipAddress, this.nameServer);

which is not doing the filtering that HBASE-4109 does.

Would this typically be filed as a new issue or brought up in comments on
the closed issue?


On Mon, Dec 17, 2012 at 8:21 PM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:

> Maybe TableInputFormatBase.getSplits is missing something similar to
> HBASE-4109?
>
> J-D
>
> On Mon, Dec 17, 2012 at 5:26 PM, Robert Dyer <psybers@gmail.com> wrote:
> > That's what I thought too.  Except I am running 0.94.2 and this fix was
> > released in 0.90.4.
> >
> >
> > On Mon, Dec 17, 2012 at 5:11 PM, Stack <stack@duboce.net> wrote:
> >
> >> On Sun, Dec 16, 2012 at 1:16 AM, Robert Dyer <psybers@gmail.com> wrote:
> >>
> >>> I recently enabled reverse DNS on my test cluster.  Now when I run a MR
> >>> job, the HBase input split locations are all adding a period to the
> end.
> >>>  For example:
> >>>
> >>> /default-rack/foo-1.
> >>> /default-rack/foo-2.
> >>>
> >>> Yet the machine locations are still correct:
> >>>
> >>> /default-rack/foo-1
> >>> /default-rack/foo-2
> >>>
> >>> Since those strings don't match, it isn't assigning the tasks locally.
>  It
> >>> actually thinks 100% of the map tasks are rack-local and 0% data-local
> >>> (although in reality, some still wind up being data-local due to sheer
> >>> luck).
> >>>
> >>> What is the issue here?  Note that I don't have this problem with the
> MR
> >>> tasks using SequenceFile as input, only with HBase's TableMapper.
> >>>
> >>
> >>
> >> Looks like https://issues.apache.org/jira/browse/HBASE-4109 ?
> >> St.Ack
> >>
> >>
>


-- 

Robert Dyer
rdyer@iastate.edu

--20cf301af943f53c5304d1176892--