Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 97837 invoked from network); 12 Jul 2007 18:55:31 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 12 Jul 2007 18:55:31 -0000 Received: (qmail 87914 invoked by uid 500); 12 Jul 2007 18:55:34 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 87680 invoked by uid 500); 12 Jul 2007 18:55:33 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 87667 invoked by uid 99); 12 Jul 2007 18:55:32 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jul 2007 11:55:32 -0700 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jul 2007 11:55:27 -0700 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id BEE7571420D for ; Thu, 12 Jul 2007 11:55:06 -0700 (PDT) Message-ID: <24815199.1184266506778.JavaMail.jira@brutus> Date: Thu, 12 Jul 2007 11:55:06 -0700 (PDT) From: "Arun C Murthy (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Updated: (HADOOP-1570) Add a per-job configuration knob to control loading of native hadoop libraries In-Reply-To: <3586499.1183739224496.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1570: ---------------------------------- Attachment: HADOOP-1570_2_20070713.patch Incorporated Doug's comments, thanks for the f/b! > Add a per-job configuration knob to control loading of native hadoop libraries > ------------------------------------------------------------------------------- > > Key: HADOOP-1570 > URL: https://issues.apache.org/jira/browse/HADOOP-1570 > Project: Hadoop > Issue Type: New Feature > Components: io > Affects Versions: 0.12.3, 0.13.0 > Reporter: Arun C Murthy > Assignee: Arun C Murthy > Fix For: 0.14.0 > > Attachments: HADOOP-1570_1_20070709.patch, HADOOP-1570_2_20070713.patch > > > As it exists today, native-hadoop libraries are loaded automatically if libhadoop.so is present; however we have sporadically seen issues (HADOOP-1545) since native direct-buffers aren't very well understood. The only way to switch off usage of these is to remove the native libraries which is a maintenence issue for large clusters... > Hence I propose we add a per-job config knob: {{hadoop.native.lib}} (set to {{true}} by default) which can be used to control usage of native libraries even when the libraries are present e.g. we can have hadoop installed with native libraries present and then use this knob to switch off their usage in rare cases we see issues with them; thus aiding maintenence. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.