hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4998) Implement a native OS runtime for Hadoop
Date Wed, 23 Dec 2009 20:36:29 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794216#action_12794216

Eli Collins commented on HADOOP-4998:

Thanks for taking a look Todd, will incorporate your feedback. The code isn't polished (eg
I just copied executeShellCommand and toString from UnixUserGroupInformation, the naming eg
getUsername vs getUserName needs to be improved, haven't tested the C code on multiple platforms,
etc), just want to get feedback on the overall approach first, the patch is just to show what
a Platform class would look like and how it could be implemented. Think the patches should
be staged in phases, eg first move the existing code that uses Shell over to the new API (w/o
changing any functionality) and then add new native implementations individually.  

bq. Less specific: thoughts on making this into an interface, with an implementation for JniPlatformCall
and ShellPlatformCall? This may be handy if someone wants to come along and implement WindowsPlatformCall
or SolarisShellPlatformCall, etc.

JNI supports multiple platforms so we should be able to have Posix and Windows implementations
of libnativecall (PlatformCall.c). Perhaps though we make Platform an interface with JNI and
Shell implementations.

> Implement a native OS runtime for Hadoop
> ----------------------------------------
>                 Key: HADOOP-4998
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4998
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: native
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.21.0
>         Attachments: hadoop-4998-1.patch
> It would be useful to implement a JNI-based runtime for Hadoop to get access to the native
OS runtime. This would allow us to stop relying on exec'ing bash to get access to information
such as user-groups, process limits etc. and for features such as chown/chgrp (org.apache.hadoop.util.Shell).

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message