pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bhooshan Mogal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PIG-3441) Allow Pig to use default resources from Configuration objects
Date Wed, 28 Aug 2013 03:23:54 GMT
Bhooshan Mogal created PIG-3441:
-----------------------------------

             Summary: Allow Pig to use default resources from Configuration objects
                 Key: PIG-3441
                 URL: https://issues.apache.org/jira/browse/PIG-3441
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: 0.11.1
            Reporter: Bhooshan Mogal


Pig currently ignores parameters from configuration files added statically to Configuration
objects as Configuration.addDefaultResource(filename.xml).

Consider the following scenario -
In a hadoop FileSystem driver for a non-HDFS filesystem you load properties specific to that
FileSystem in a static initializer block in the class that extends org.apache.hadoop.fs.Filesystem
for your FileSystem like below - 
{code}

class MyFileSystem extends FileSystem {

        static {
		Configuration.addDefaultResource("myfs-default.xml");
		Configuration.addDefaultResource("myfs-site.xml");
	}


}
{code}

Interfaces like the Hadoop CLI, Hive, Hadoop M/R can find configuration parameters defined
in these configuration files as long as they are on the classpath.

However, Pig cannot find parameters from these files, because it ignores configuration files
added statically.

Pig should allow users to specify if they would like pig to read parameters from resources
loaded statically.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message