hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Dimiduk <ndimi...@gmail.com>
Subject Re: Tablesplit.getLength returns 0
Date Thu, 30 Jan 2014 17:14:50 GMT
Sounds good, I'll watch for your patch!

On Thursday, January 30, 2014, Lukas Nalezenec <
lukas.nalezenec@firma.seznam.cz> wrote:

> I talked with guy who worked on this and he said our production issue was
> probably not directly caused by getLength() returning 0.
> Anyway, we are interested in fixing that, estimating length from files is
> good idea.
>
> Lukas
>
>  InputSplit.getLength() and RecordReader.getProgress() is important for the
>> MR framework to be able to show progress etc. It would be good to return
>> raw data sizes in getLength() computed from region's total size of store
>> files, and progress being calculated from scanner's amount of raw data
>> seen.
>>
>
> Enis
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message