Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of rohitkelkar@gmail.com
 designates 209.85.223.177 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CACHGzSSFLfC+RLTeajUO7Dq2h=AbMYpxhQiRdH6vFWZ3UgqUPg@mail.gmail.com>
References: 
 <CALCVZZvWgNaU_BKzvZ8_eh7HVi4YROmP7aXN-OxVfJHT0w90BQ@mail.gmail.com>
	<CADcMMgG6p-Jj=ODsc0HY_AaHmVc9p6gRhMRz=mzaWGqpvgo6RQ@mail.gmail.com>
	<CALCVZZtDti-fjf-SEZP1AZBujSzUAmWvv+2zgXZAsf=OrQrQ4Q@mail.gmail.com>
	<CACHGzSSCm2dAG1dBemDE7MA1M23pMsriDk2QsDD=bDLRrPd3FQ@mail.gmail.com>
	<CALCVZZsxAamer1ht055r=3xTBC2gGNR1nDVQvo3U1nNtiKq_AQ@mail.gmail.com>
	<CACHGzSSFLfC+RLTeajUO7Dq2h=AbMYpxhQiRdH6vFWZ3UgqUPg@mail.gmail.com>
Date: Wed, 19 Jun 2013 23:08:58 -0500
Message-ID: 
 <CALCVZZs2VAAVqX9D2mQCH+k4VWn4wGp_ffn1v3zTixbSb4T8JQ@mail.gmail.com>
Subject: Re: Problem with HFile lexical comparison
From: Rohit Kelkar <rohitkelkar@gmail.com>
To: user@hbase.apache.org
Content-Type: multipart/alternative; boundary=047d7bdc150a04ebd404df8e1b65

--047d7bdc150a04ebd404df8e1b65
Content-Type: text/plain; charset=ISO-8859-1

Perfect. That worked. Thanks.

- R


On Wed, Jun 19, 2013 at 7:23 PM, Jeff Kolesky <jeff@opower.com> wrote:

> Last time I wrote directly to an HFile, I instantiated an HFile.Writer
> using this statement:
>
>         HFile.Writer writer = HFile.getWriterFactory(config)
>             .createWriter(fs, hfilePath,
>                     (bytesPerBlock * 1024),
>                     Compression.Algorithm.GZ,
>                     KeyValue.KEY_COMPARATOR);
>
> Perhaps you need the declaration of the comparator in the create statement
> for the writer.
>
> Jeff
>
>
>
> On Wed, Jun 19, 2013 at 5:11 PM, Rohit Kelkar <rohitkelkar@gmail.com>
> wrote:
>
> > Thanks for the replies, I tried the KeyValue.KVComparator but still no
> > luck. So I commented the comparator and played around with the sequence
> of
> > writing the qualifiers to the HFile. (see code here:
> > https://gist.github.com/anonymous/5819254)
> >
> > If I set the variable String[] starr = new String[]{"a", "d", "dt",
> "dth"}
> > then the code breaks while writing the qualifier "dt" to the HFile.
> > If I set the variable String[] starr = new String[]{"a", "dth", "dt",
> "d"}
> > then the code runs successfully.
> > If I set the variable String[] starr = new String[]{"dth", "dt", "d",
> "a"}
> > then the code breaks while writing "a" to the HFile
> >
> > Does this mean that if the qualifiers start with the same character then
> > the longest qualifier should be written first? Else the usual lexical
> order
> > is honoured?
> >
> > The code throws following stack trace
> > Added a key not lexically larger than previous
> >
> >
> key=\x00\x1B10011-2-0000000000000000703\x02sddt\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04,
> >
> >
> lastkey=\x00\x1B10011-2-0000000000000000703\x02sdd\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xFF\x04
> >  at
> >
> >
> org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.checkKey(AbstractHFileWriter.java:207)
> > at
> >
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.append(HFileWriterV2.java:317)
> >  at
> >
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.append(HFileWriterV2.java:282)
> > at com.mycompany.hbase.process.myprocess.myFunction(MyClass.java:1492)
> >
> > I am using hbase-0.94.2
> >
> > - Rohit Kelkar
> >
> >
> > On Wed, Jun 19, 2013 at 1:15 PM, Jeff Kolesky <jeff@opower.com> wrote:
> >
> > > I believe you need to use the KVComparator:
> > >
> > >
> > >
> >
> https://github.com/apache/hbase/blob/trunk/hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValue.java#L88
> > >
> > > Jeff
> > >
> > >
> > > On Wed, Jun 19, 2013 at 10:32 AM, Rohit Kelkar <rohitkelkar@gmail.com
> > > >wrote:
> > >
> > > > Here is the code - https://gist.github.com/anonymous/5816180
> > > >
> > > > I guess the issue is with my use of the comparator function.
> > > >
> > > > - R
> > > >
> > >
> > >
> > >
> > > --
> > > *Jeff Kolesky*
> > > Chief Software Architect
> > > *Opower*
> > >
> >
>
>
>
> --
> *Jeff Kolesky*
> Chief Software Architect
> *Opower*
>

--047d7bdc150a04ebd404df8e1b65--