hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-879) TestTaskTrackerLocalization fails on MAC OS
Date Wed, 16 Dec 2009 17:56:18 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791484#action_12791484

Allen Wittenauer commented on MAPREDUCE-879:

If I'm looking at the code correctly, it does the same thing. :(

   /// loads permissions, owner, and group from `ls -ld`
    private void loadPermissionInfo() {
      IOException e = null;
      try {
        StringTokenizer t = new StringTokenizer(
            execCommand(new File(getPath().toUri()),
        //expected format
        //-rw-------    1 username groupname ...

The problem is that ls is one of the shell commands that output was never defined for users/groups
over 8 characters because at the time, UNIX didn't support users/groups over 8 characters.
Thus every OS does their own thing when faced with this situation.  Some put a space such
that awk works, some truncate to 8, some smash them all together.  [In the case of Solaris,
the official response is "Not Support" much to the angst of the SA community, but Sun is specifically
trying to avoid undefined behavior like this one.] 

stat (as we've discovered) isn't portable either.

Best bet is probably to shell out a shell script that does the proper thing for the OS it
is running on until we get a decent JNI library in place.

> TestTaskTrackerLocalization fails on MAC OS
> -------------------------------------------
>                 Key: MAPREDUCE-879
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-879
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.21.0
>         Environment: Mac OS X 10.5.7
>            Reporter: Devaraj Das
>            Assignee: Sreekanth Ramakrishnan
>            Priority: Blocker
>             Fix For: 0.21.0
>         Attachments: mapreduce-879-1.patch, TEST-org.apache.hadoop.mapred.TestTaskTrackerLocalization.txt
> TestTaskTrackerLocalization failed on an 'ant test' run.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message