hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lukas Nalezenec <lukas.naleze...@firma.seznam.cz>
Subject Re: Tablesplit.getLength returns 0
Date Thu, 30 Jan 2014 08:58:53 GMT
I talked with guy who worked on this and he said our production issue 
was probably not directly caused by getLength() returning 0.
Anyway, we are interested in fixing that, estimating length from files 
is good idea.


> InputSplit.getLength() and RecordReader.getProgress() is important for the
> MR framework to be able to show progress etc. It would be good to return
> raw data sizes in getLength() computed from region's total size of store
> files, and progress being calculated from scanner's amount of raw data seen.


View raw message