Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5F933921D for ; Wed, 28 Mar 2012 10:16:53 +0000 (UTC) Received: (qmail 91471 invoked by uid 500); 28 Mar 2012 10:16:53 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 91440 invoked by uid 500); 28 Mar 2012 10:16:53 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 91432 invoked by uid 99); 28 Mar 2012 10:16:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Mar 2012 10:16:53 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Mar 2012 10:16:50 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id D1A8734AB96 for ; Wed, 28 Mar 2012 10:16:29 +0000 (UTC) Date: Wed, 28 Mar 2012 10:16:29 +0000 (UTC) From: "Eran Kutner (Commented) (JIRA)" To: issues@hbase.apache.org Message-ID: <851558616.28047.1332929789873.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1037250345.10636.1308223427899.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-3996) Support multiple tables and scanners as input to the mapper in map/reduce jobs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240335#comment-13240335 ] Eran Kutner commented on HBASE-3996: ------------------------------------ There is one pending change I know about, and that is making TableInputConf a static inner class. As for versionning I'll look at it but can't say when. Other than that I'm waiting to hear back from @Lars regarding my response to his suggestions on reusing TableInputFormatBase. Sorry for being slow to respond, I'm very busy with other things these days, so feel free to make any changes you feel are right. > Support multiple tables and scanners as input to the mapper in map/reduce jobs > ------------------------------------------------------------------------------ > > Key: HBASE-3996 > URL: https://issues.apache.org/jira/browse/HBASE-3996 > Project: HBase > Issue Type: Improvement > Components: mapreduce > Reporter: Eran Kutner > Assignee: Eran Kutner > Fix For: 0.96.0 > > Attachments: 3996-v2.txt, 3996-v3.txt, 3996-v4.txt, 3996-v5.txt, HBase-3996.patch > > > It seems that in many cases feeding data from multiple tables or multiple scanners on a single table can save a lot of time when running map/reduce jobs. > I propose a new MultiTableInputFormat class that would allow doing this. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira