hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-786) Jobtracker history should be written aysnchronously to the filesystem
Date Wed, 23 Jul 2014 20:05:41 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer resolved MAPREDUCE-786.
----------------------------------------

    Resolution: Incomplete

Closing this as stale, given how history is handled these days in YARN+MR.

> Jobtracker history should be written aysnchronously to the filesystem
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-786
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-786
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: jobtracker
>            Reporter: Sharad Agarwal
>            Assignee: Sharad Agarwal
>
> Jobtracker lock is held while writing the history events. This makes the jobtracker slow
on flushes, especially when history is written to HDFS. History events should be written asynchronously
to avoid this problem.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message