hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1570) Add a per-job configuration knob to control loading of native hadoop libraries
Date Mon, 09 Jul 2007 10:12:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511069

Hadoop QA commented on HADOOP-1570:


http://issues.apache.org/jira/secure/attachment/12361402/HADOOP-1570_1_20070709.patch applied
and successfully tested against trunk revision r554144.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/374/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/374/console

> Add a per-job configuration knob to control loading of native hadoop libraries 
> -------------------------------------------------------------------------------
>                 Key: HADOOP-1570
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1570
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: io
>    Affects Versions: 0.12.3, 0.13.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.14.0
>         Attachments: HADOOP-1570_1_20070709.patch
> As it exists today, native-hadoop libraries are loaded automatically if libhadoop.so
is present; however we have sporadically seen issues (HADOOP-1545) since native direct-buffers
aren't very well understood. The only way to switch off usage of these is to remove the native
libraries which is a maintenence issue for large clusters...
> Hence I propose we add a per-job config knob: {{hadoop.native.lib}} (set to {{true}}
by default) which can be used to control usage of native libraries even when the libraries
are present e.g. we can have hadoop installed with native libraries present and then use this
knob to switch off their usage in rare cases we see issues with them; thus aiding maintenence.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message