hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billy Pearson" <sa...@pearsonwholesale.com>
Subject TableOutputFormat
Date Wed, 08 Oct 2008 21:12:26 GMT
I am running jobs and I am noticing that the % done on the reduce jobs is 
hitting 100% way before the job is done writing to the table

I run a map and reduce and use setOutputFormat(TableOutputFormat.class) to 
write the reducer's BatchUpdates to the table I need
but on say 10M rows to update the reduce show 100% done at say a few mins 
but do not complete for 30+ mins.

Any idea on why this is happening now it was not acting like this before in 
0.2?
Is there a new buffer holding the reduce output or something like that?

Billy



Mime
View raw message