hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: HBase Scan returns fewer columns after a few minutes of insertion
Date Tue, 30 Aug 2011 17:16:19 GMT
If you want to limit the number of rows you can instead set the
caching to exactly what you need, or set a stop row.

J-D

On Mon, Aug 29, 2011 at 11:38 PM, Neerja Bhatnagar <neerjapub@gmail.com> wrote:
> Hi J-D,
>
> Thank you very much! Hopefully, this iteration clears it up for me.
> The batchSize is set to 1. I tried the same code with batchSize set to
> nothing or the same number as the number of columns in my column family.
> When the batchsize is not set, or is set to the number of columns in the
> column family I am retrieving from getMap or getFamilyMap, then the entire
> result (as expected) is returned.
>
> Is batchsize setting the number of columns to return, rather than number of
> rows?
> I am sorry,  to me it is not clear if the API is for setBatch in Scan is
> row-oriented or column-oriented.
>
> Perhaps, I should use the PageFilter to limit the number of rows retrieved
> from HBase?
> setBatch
>
> public void *setBatch*(int batch)
>
> Set the maximum number of values to return for each call to next()
>
> *Parameters:*batch - the maximum number of valuesYour help is much
> appreciated. Cheers, Neerja
>
> On Mon, Aug 29, 2011 at 7:07 PM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:
>
>> (Sending to user@ again and bccing dev@ for the last time, please take
>> notice and reply to user@)
>>
>> Ok so it should be something about the code... what is batchSize set
>> to? I don't see it in that code snippet.
>>
>> getMap gives a map of all the families with all the data, whereas
>> getFamily gives a map of all the qualifiers and their values for one
>> family. Both APIs are good, just solving a different problem.
>>
>> J-D
>>
>> On Mon, Aug 29, 2011 at 6:00 PM, Neerja Bhatnagar <neerjapub@gmail.com>
>> wrote:
>> > Hi J-D,
>> >
>> > Thanks! I do scan 'tablename' on the shell, and I can see all 3 columns
>> in
>> > the 1 column family for a row. I haven't set any TTL on the table or
>> result
>> > scanner.
>> > Any other suggestions would be very welcome. I was getting the same
>> response
>> > with result.getFamilyMap() and I moved to result.getMap() thinking I was
>> > using the wrong api.
>> >
>> > Cheers, Neerja
>> >
>> > On Mon, Aug 29, 2011 at 5:23 PM, Jean-Daniel Cryans <jdcryans@apache.org
>> >wrote:
>> >
>> >> (sending to user@ and bbcing dev@ since this is a user question)
>> >>
>> >> That type of problem can be "fun" to debug, did you try with the shell
>> >> to query the data? Do you get a different result?
>> >>
>> >> BTW, any TTL set on that table?
>> >>
>> >> J-D
>> >>
>>
>

Mime
View raw message