hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Hammerbacher" <jeff.hammerbac...@gmail.com>
Subject Re: save job.xml files in history
Date Mon, 10 Sep 2007 09:03:32 GMT
seems like the easiest way to do this would be to do an asynchronous POST at
the end of JobClient.submitJob(); send job.toString() and do whatever
logging you want at the receiving end.

also, it seems as though job.toString() a different format from job.write()
-- does that bother people?

On 9/10/07, Frédéric Bertin <frederic.bertin@anyware-tech.com> wrote:
>
> Hi all,
>
> Has anyone already tackled the problem of saving all submitted jobs
> configuration files (job.xml)? AFAIU, the current job history feature
> only saves the path to the jobconf, located in mapred.system.dir. But
> this folder is deleted whenever the job tracker is restarted.
> Is there already a simple way of doing this?
>
> Thanks,
> Fred
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message