hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Piotr Kołaczkowski (JIRA) <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5126) Add possibility to set a custom system classloader for mapred child processes, separate from mapred.child.java.opts
Date Thu, 04 Apr 2013 10:21:15 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Piotr Kołaczkowski updated MAPREDUCE-5126:
------------------------------------------

    Affects Version/s: 1.0.4
    
> Add possibility to set a custom system classloader for mapred child processes, separate
from mapred.child.java.opts
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5126
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5126
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>    Affects Versions: 1.0.4
>            Reporter: Piotr Kołaczkowski
>            Priority: Minor
>         Attachments: custom-classloader.patch
>
>
> Some third party frameworks / systems based on Hadoop might want to set a custom classloader
for loading classes of their jobs to better resolve conflicts with their libraries. 
> While it is possible to set a custom classloader using the mapred.child.java.opts, this
field is often overriden by users in their job configuration. So in order to change e.g. heap
sizes the user would need to remember also to include the custom classloader property from
the framework-defaults or otherwise he would break the framework.
> This small patch introduces another parameter: mapred.child.java.class.loader that allows
to set the classloader separately. This gives custom frameworks built on top of Hadoop more
flexibility to supply their own classloader, without need to force users to adjust any settings.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message