hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj Das (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5785) The job setup and cleanup tasks should be optional
Date Wed, 20 May 2009 11:39:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12711105#action_12711105

Devaraj Das commented on HADOOP-5785:

Justification why it should be cluster-level config: (1) It is probably something that would
conflict with the model of having setup/cleanup tasks in the first place, and hence should
be applicable for all jobs or none. (2) It is for latency sensitive apps, and such jobs are
usually benchmarks (like terasort) for which we probably will have a dedicated cluster, where
we would run only such jobs (3) Might add to confusion when it comes to debugging jobs or
the cluster itself.
The above is my opinion.. Open for discussion. I don't have a very strong preference for one
over the other.

> The job setup and cleanup tasks should be optional
> --------------------------------------------------
>                 Key: HADOOP-5785
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5785
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Owen O'Malley
>            Assignee: Amareshwari Sriramadasu
> For jobs that require low latency and do not require setup or cleanup tasks for the job,
it should be possible to turn them off for that job.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message