hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4017) Add jobname to jobsummary log
Date Tue, 10 Apr 2012 20:35:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251037#comment-13251037
] 

Robert Joseph Evans commented on MAPREDUCE-4017:
------------------------------------------------

The patches look good, my only comment on them is that up to this point nothing in the job
summary log was directly controllable by the user.  The job name is, and it may make correctly
parsing the data more difficult then it was before.  The SummaryBuilder escapes commas with
a '\', but anyone doing the simple thing that the tests do, line.split(',') will not work
correctly.  I am not sure if there is much we can do about it, except add it to the release
notes.
                
> Add jobname to jobsummary log
> -----------------------------
>
>                 Key: MAPREDUCE-4017
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4017
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobhistoryserver, jobtracker
>    Affects Versions: 0.20.205.0, 0.23.0
>            Reporter: Koji Noguchi
>            Assignee: Thomas Graves
>            Priority: Trivial
>         Attachments: MAPREDUCE-4017-v0.20-1.patch, MAPREDUCE-4017.patch
>
>
> We occasionally use jobsummary from the JobTracker to collect users' slot usage on our
clusters.  It would be useful if the jobname was part of this jobsummary so that I don't need
to join with other logs.
> Same jobsummary.
>   2012-03-15 16:05:55,919 INFO mapred.JobInProgress$JobSummary: jobId=job_201202160624_1089972,submitTime=1331827523632,launchTime=1331827528197,firstMapTaskLaunchTime=1331827536917,firstReduceTaskLaunchTime=1331827541251,firstJobSetupTaskLaunchTime=1331827528200,firstJobCleanupTaskLaunchTime=1331827551655,finishTime=1331827555919,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=tortuga,queue=queue1,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=10,clusterMapCapacity=____,clusterReduceCapacity=____
> I'd like to see "jobName" added to the end.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message