hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eason.Lee" <leongf...@gmail.com>
Subject How to report the status
Date Mon, 14 Sep 2009 08:11:25 GMT
I am using hadoop Map job to import data into hbase from DB
For there is more than 10M records.It takes more than 10 minutes to finish
one map job.
So I got  "failed to report status for 604 seconds" Error!

I have set in my Map as followed:
cnkiTable.put(put);
 if ((++count % 1000)==0) {
   context.setStatus((count / len) +" done!");
   context.progress();
  }

but it seems no use

do I have to implements my on reporter?

anyone can help me ?

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message