Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 451B8175D6 for ; Sat, 28 Mar 2015 06:03:03 +0000 (UTC) Received: (qmail 5515 invoked by uid 500); 28 Mar 2015 06:03:00 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 5447 invoked by uid 500); 28 Mar 2015 06:03:00 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 5435 invoked by uid 99); 28 Mar 2015 06:03:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 Mar 2015 06:03:00 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.220.52 as permitted sender) Received: from [209.85.220.52] (HELO mail-pa0-f52.google.com) (209.85.220.52) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 Mar 2015 06:02:55 +0000 Received: by pabxg6 with SMTP id xg6so115403528pab.0 for ; Fri, 27 Mar 2015 23:02:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:mime-version:subject :message-id:date:references:in-reply-to:to; bh=MDeKQFezpO80HFPf/2wX+J/01gSD0jcye1i2P/oHV0E=; b=QnLuj3wWbLDCcoSL8RiwzZL0/XJMqFrYb3OlkN85AxNO0Y9LTuoAlhBRx6ZhYdmQuD nLUjry27kFikzVWJREn82oDnAkyOo1uZ7+h1k3yqUIIZDfvwYEKm8WG1uY7La0EyeP9g h1gXSRbkJc5dVBYwZ76Y29KqavET+80xKjnRwBgBkKkoBste3eBMxCF1UD4GTVEpYI8d C8tL+NcxgCXgTln5KQ9VoRxvzCKIj60120uaDGu+NQUjISdnwvM8urEks57lnc6zM33v bV1x/fSQhUrg5r/48+au9sD9VTJQpuQ/eLYPPtMrc/enqivVbOWa+Q4y19yN/dNy4cx3 bQoA== X-Received: by 10.68.239.104 with SMTP id vr8mr40947882pbc.96.1427522554448; Fri, 27 Mar 2015 23:02:34 -0700 (PDT) Received: from [192.168.0.16] (c-24-130-236-83.hsd1.ca.comcast.net. [24.130.236.83]) by mx.google.com with ESMTPSA id c2sm3886042pbu.73.2015.03.27.23.02.33 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 27 Mar 2015 23:02:33 -0700 (PDT) From: Ted Yu Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) Subject: Re: Multiple scans for mapreduce over snapshots Message-Id: <8507952B-F082-44AF-BDCF-1CE7F5FAD353@gmail.com> Date: Fri, 27 Mar 2015 23:02:32 -0700 References: <5515A729.5030309@upsight.com> In-Reply-To: <5515A729.5030309@upsight.com> To: "user@hbase.apache.org" X-Mailer: iPhone Mail (12D508) X-Virus-Checked: Checked by ClamAV on apache.org I think adding support for multi table scan over snapshots would be a nice f= eature to have.=20 > On Mar 27, 2015, at 11:53 AM, Andrew Mains wr= ote: >=20 > Hi all, >=20 > We're looking into using TableSnapshotInputFormat on a salted table, and w= e need to push down conditions on the rest of the rowkey to each bucket (usi= ng hive with my patch for https://issues.apache.org/jira/browse/HIVE-7805). M= ultiTableInputFormat allows us to do this on HBase proper, but it seems like= this isn't yet supported on snapshots. There's nothing in either google or J= IRA discussing such a feature afaict, so I thought I'd ask here: >=20 > Would it be reasonable for HBase to support an equivalent of `MultiTableIn= putFormat` over snapshots? Is there a better alternative that we should be u= sing instead? >=20 > Thanks! >=20 > Andrew