hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benjamin Francisoud (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-93) Impossible to set jobconf parameters
Date Tue, 05 Feb 2008 16:20:08 GMT
Impossible to set jobconf parameters
------------------------------------

                 Key: PIG-93
                 URL: https://issues.apache.org/jira/browse/PIG-93
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: 0.1.0
            Reporter: Benjamin Francisoud
            Priority: Critical


I'm trying to set jobconf parameter before launching a pig job using pig api.

I tried 2 different ways but with no success:
{code:java}
PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
pigContext.getExecutionEngine().getConfiguration().putAll(properties);
PigServer pigServer = new PigServer(pigContext);
....
{code}

Throw a NPE because the internal executionEngine var is initialize only when calling connect().

So I tried:
{code:java}
PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
pigContext.connect();
pigContext.getExecutionEngine().getConfiguration().putAll(properties);
PigServer pigServer = new PigServer(pigContext);
...
{code}

My properties have been replace with a "new JobConf()"
{noformat}
java.lang.RuntimeException: Bad mapred.job.tracker: local
at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:711)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:149)
at org.apache.pig.impl.PigContext.connect(PigContext.java:180)
{noformat}

"properties" contains "mapred.job.tracker" and "hadoop.tmp.dir values"

Before PIG-32 I use to do (and it was working): 
{code:java}
PigContext pigContext = new PigContext(ExecType.MAPREDUCE);
pigContext.setConf(myJobConf);
PigServer pigServer = new PigServer(pigContext);
...
{code}

Any idea before I start to work on a patch ?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message