hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4670) Improve the way job history files are managed
Date Mon, 17 Nov 2008 07:48:46 GMT
Improve the way job history files are managed

                 Key: HADOOP-4670
                 URL: https://issues.apache.org/jira/browse/HADOOP-4670
             Project: Hadoop Core
          Issue Type: Improvement
          Components: mapred
    Affects Versions: 0.20.0
            Reporter: Amar Kamat
             Fix For: 0.20.0

Today all the jobhistory files are dumped in one _job-history_ folder. This can cause problems
when there is a need to search the history folder (job-recovery etc). It would be nice if
we group all the jobs under a _user_ folder. So all the jobs for user _amar_ will go in _history-folder/amar/_.
Jobs can be categorized using various features like _jobid, date, jobname_ etc but using _username_
will make the search much more efficient and also will not result into namespace explosion.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message