crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CRUNCH-490) Prefer mapreduce.framework.name for determining which version of MR is running
Date Fri, 23 Jan 2015 07:02:34 GMT
Josh Wills created CRUNCH-490:
---------------------------------

             Summary: Prefer mapreduce.framework.name for determining which version of MR
is running
                 Key: CRUNCH-490
                 URL: https://issues.apache.org/jira/browse/CRUNCH-490
             Project: Crunch
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.11.0
            Reporter: Josh Wills
            Assignee: Josh Wills
            Priority: Minor
             Fix For: 0.12.0


We use a different poll interval for the MRExecutor depending on whether or not we're running
in local mode, and we determine whether or not we're running in local mode based on the value
of the mapreduce.jobtracker.address property in the configuration. However, a more reliable
way to do this is by checking the mapreduce.framework.name, esp. for yarn-based jobs that
will not have a meaningful value for the jobtracker property.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message