hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "bc Wong (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6153) Apply `mapreduce.admin.user.env' to AM
Date Thu, 06 Nov 2014 23:35:33 GMT
bc Wong created MAPREDUCE-6153:

             Summary: Apply `mapreduce.admin.user.env' to AM
                 Key: MAPREDUCE-6153
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6153
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: applicationmaster
    Affects Versions: 2.5.0
            Reporter: bc Wong

Would be nice to be able to manipulate the AM's library path to include snappy. The `mapreduce.admin.user.env'
seems perfect for this, except that it only affects the tasks. I think it's useful to have
it apply to the AM as well.

Use case: I have a job that uses the output committer (which runs in the AM) to read the output
file of the reducer, which is compressed using snappy.

This message was sent by Atlassian JIRA

View raw message