Return-Path: Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: (qmail 55611 invoked from network); 28 Feb 2011 18:34:03 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 28 Feb 2011 18:34:03 -0000 Received: (qmail 41014 invoked by uid 500); 28 Feb 2011 18:34:03 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 40349 invoked by uid 500); 28 Feb 2011 18:34:00 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 40299 invoked by uid 99); 28 Feb 2011 18:34:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Feb 2011 18:34:00 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Feb 2011 18:33:58 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 31B83420CF for ; Mon, 28 Feb 2011 18:33:37 +0000 (UTC) Date: Mon, 28 Feb 2011 18:33:37 +0000 (UTC) From: "Dan Harvey (JIRA)" To: issues@hbase.apache.org Message-ID: <2096854458.2388.1298918017200.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <44567607.1349.1298893897110.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] Commented: (HBASE-3578) TableInputFormat does not setup the configuration for HBase mapreduce jobs correctly MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000454#comment-13000454 ] Dan Harvey commented on HBASE-3578: ----------------------------------- Thanks that should be fine, it's not a critical issue just will make things cleaner to work with. For us as I didn't want to use a patched version of HBase in production with upgrading to 0.90 I've modified all our jobs to configure things as needed, but it would be great if we didn't have to do this all the time. > TableInputFormat does not setup the configuration for HBase mapreduce jobs correctly > ------------------------------------------------------------------------------------ > > Key: HBASE-3578 > URL: https://issues.apache.org/jira/browse/HBASE-3578 > Project: HBase > Issue Type: Bug > Components: mapreduce > Affects Versions: 0.90.0, 0.90.1 > Reporter: Dan Harvey > Assignee: Dan Harvey > Fix For: 0.92.0 > > Attachments: mapreduce_configuration.patch > > > In 0.20.x and earlier TableMapReduceUtil (and other Input/OutputFormat classes) used to setup the HTable with a HBaseConfiguration object, now that has been deprecated in #HBASE-2036 they are constructed with Hadoop configuration objects which do not contain the configuration xml file resources required to setup HBase. I think it is currently expected this is done when constructing the job but as this needs to be done for every HBase mapreduce job it would be cleaner if the TableMapReduceUtil class did this whilst setting up the TableInput/OutputFormat classes. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira