hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sameer M (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-1481) PigServer throws exception if it cannot find hadoop-site.xml or core-site.xml
Date Fri, 02 Jul 2010 22:13:50 GMT
PigServer throws exception if it cannot find hadoop-site.xml or core-site.xml
-----------------------------------------------------------------------------

                 Key: PIG-1481
                 URL: https://issues.apache.org/jira/browse/PIG-1481
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.8.0
            Reporter: Sameer M


Hi

We've been using the Hadoop MiniCluster to do unit testing of our pig scripts in the following
way.

MiniCluster minicluster = MiniCluster.buildCluster(2,2);
pigServer = new  PigServer(ExecType.MAPREDUCE, minicluster.getProperties());

This has been working fine for 0.6 and 0.7. 

However in the trunk (0.8) looks like there is change due to which an exception is thrown
if hadoop-site.xml or core-site.xml is not found in the classpath.

org.apache.pig.backend.executionengine.ExecException: ERROR 4010: Cannot find hadoop configurations
in classpath (neither hadoop-site.xml nor core-site.xml was found in the classpath).If you
plan to use local mode, please put -x local option in command line
	at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:149)
	at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:114)
	at org.apache.pig.impl.PigContext.connect(PigContext.java:177)
	at org.apache.pig.PigServer.<init>(PigServer.java:215)
	at org.apache.pig.PigServer.<init>(PigServer.java:204)
	at org.apache.pig.PigServer.<init>(PigServer.java:200)


The problem seems to be org.apache.pig.backend.hadoop.executionengine.HExecutionEngine: 148
            if( hadoop_site == null && core_site == null ) {
            	throw new ExecException("Cannot find hadoop configurations in classpath (neither
hadoop-site.xml nor core-site.xml was found in the classpath)." +
            			"If you plan to use local mode, please put -x local option in command line",

            			4010);
            }

We would like to use the mapreduce mode but with the minicluster and have a lot of unit test
with that setup.

Can this check be removed from this level ?

Thanks
Sameer

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message