hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5785) The job setup and cleanup tasks should be optional
Date Wed, 20 May 2009 14:26:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12711158#action_12711158
] 

Vinod K V commented on HADOOP-5785:
-----------------------------------


i think it should be job specific as we specify setup/cleanup via OutputCommitter which itself
is job specific.

Also, instead of configuration, as JobSetup and JobCleanup are specified via the job's OutPutCommitter,
why not have something in the lines of the following and use them generically to determine
if a job needs setup/cleanup. 
{code}
OutputCommitter.isJobSetupNeeded()
OutputCommitter.isJobCleanupNeeded()
{code}
Thoughts?

> The job setup and cleanup tasks should be optional
> --------------------------------------------------
>
>                 Key: HADOOP-5785
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5785
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Owen O'Malley
>            Assignee: Amareshwari Sriramadasu
>
> For jobs that require low latency and do not require setup or cleanup tasks for the job,
it should be possible to turn them off for that job.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message