hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4145) [HOD] Support an accounting plugin script for HOD
Date Thu, 11 Sep 2008 03:52:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12630081#action_12630081

Hemanth Yamijala commented on HADOOP-4145:

The attached patch implements the following changes in HOD. There are slight differences from
the proposal listed above, which are also described below.


- Hod client looks for a specific file in the {{install-directory/bin}} folder called {{verify-account}}.
If this file is found, before cluster allocation is begun,  it executes the file passing in
{{resource_manager.pbs-account}} as a parameter to the script.
- If the script's exit code is non-zero, Hod client fails allocation. Any output generated
by the script (either on stdout or stderr) is printed to the Hod client.
- Hod exits the allocation process with a return value of 5, standing for job execution failure.
- If the verify-account script is not found, or if the script returns a zero exit code, Hod
client proceeds allocation as is.
- A dummy script file verify-account is added in the patch which sites can modify with their
custom verification script. The dummy script file just exits with 0.
- Documentation changes are done in the Hod admin guide and user guide.

Changes from the proposal:

- There are no configuration options introduced in this patch. This is essentially because
Hod cannot control users overriding configuration set up by administrators. And the account
script file should not be overridden.
- No support for passing parameters to the account verification script. Again the reason is
roughly the same as for the first point above. Also, we don't have enough use cases to see
if this additional feature is essential. It should be possible to workaround by generating
verification scripts that directly have these arguments.
- All output from the script is displayed to the user, not just stderr output. This is because
HOD currently has no good way of capturing only stderr output.

> [HOD] Support an accounting plugin script for HOD
> -------------------------------------------------
>                 Key: HADOOP-4145
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4145
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: contrib/hod
>            Reporter: Hemanth Yamijala
>            Assignee: Hemanth Yamijala
>            Priority: Blocker
>             Fix For: 0.18.1, 0.19.0
>         Attachments: HADOOP-4145.patch
> Production environments have accounting packages to track usage of a cluster. HOD should
provide a mechanism to plug-in an accounting related script that can be used to verify if
the user is using a valid account or not.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message