Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1F3081864A for ; Fri, 26 Feb 2016 10:26:10 +0000 (UTC) Received: (qmail 4934 invoked by uid 500); 26 Feb 2016 10:25:52 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 4840 invoked by uid 500); 26 Feb 2016 10:25:52 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 4009 invoked by uid 99); 26 Feb 2016 10:25:52 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Feb 2016 10:25:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D54FB180492; Fri, 26 Feb 2016 10:25:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.448 X-Spam-Level: * X-Spam-Status: No, score=1.448 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id WcwuNAHFdZ_m; Fri, 26 Feb 2016 10:25:50 +0000 (UTC) Received: from mail-qg0-f41.google.com (mail-qg0-f41.google.com [209.85.192.41]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 8C4845F2C2; Fri, 26 Feb 2016 10:25:50 +0000 (UTC) Received: by mail-qg0-f41.google.com with SMTP id y89so61630630qge.2; Fri, 26 Feb 2016 02:25:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to; bh=Gv+wBrAu4une9p/gdW6OjGdhRWcujnhbs9G+XrGfE6c=; b=uyrjGxWaISkqMZdCMClKr+PnmwdsLI4dlnOvPVjRzB4bhtiFxfkV5iR8X252gwgg4f 4Wt7A79RM7FRq5OBdJ1giQr0ztJypAE537NzbcUTT5s3nD4D4ENR2SXMKfTvJH8kryPo WdLZNlvTzV5rwDz27DuigH5VtI3nXa5Oaop+D+ZNtjC2CMspDhW6kTXZ6DUfXEpUVpAL VmFDNWEmx9VElnWG0xDxOQ9DPFDohlJTj4FEXCg8ufUyTbmKDc7eNS6bSYhQ0PCB/xAW yB1LjO9jp9jdclmjfFq7399xgDkvYvo/qWQHQWH+jH4diWtEIhM+86fiY0NdqiReeVcL Dvbg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Gv+wBrAu4une9p/gdW6OjGdhRWcujnhbs9G+XrGfE6c=; b=CNw+JbsF7wBrJjJpwPT0x6lGR197RqfU5pMWO0P8MWFjojBnhlFQFGTl2t1MleCS7a yaC/VQoEMY8DjaI3He4l73k/8zmte8uQLfGND8HMf+e08C47g65kzPxARNRTTLSvBzwD W+FEbeH/Unw+SXHGx/tKhhARspqf1slS1VBUgLqdk/KOHe7X3KmfzTqhVZ49JpfhEtQO I2ARTXZjjpW0HAfZrDLnBDFK8laBmd6WapShOjn+DaXVy/4K404Bfk8s/0rEZcaJxl36 EvFh42TuAfkJaztscZIAN7tqvEdVBhplgdnKaIeoxqJnJrYVeleJq4ASpS4TmNUJ+/3V fx2g== X-Gm-Message-State: AD7BkJKI6ywqylWKmGQVqs7ov1U0ZKuG9tirRFM0uKwBRYtsC1dOXg4+fg86uO0PBk+Q1M9b6+bPSg4jO8K2rw== X-Received: by 10.140.247.2 with SMTP id s2mr864536qhc.72.1456482343835; Fri, 26 Feb 2016 02:25:43 -0800 (PST) MIME-Version: 1.0 Received: by 10.55.65.20 with HTTP; Fri, 26 Feb 2016 02:25:04 -0800 (PST) From: Amey Barve Date: Fri, 26 Feb 2016 15:55:04 +0530 Message-ID: Subject: predicate push down with custom StorageHandler To: user@hive.apache.org, dev@hive.apache.org Content-Type: multipart/alternative; boundary=001a11393f54b9de82052ca9b8ca --001a11393f54b9de82052ca9b8ca Content-Type: text/plain; charset=UTF-8 Hi All, I have implemented HiveStoragePredicateHandler for my StorageHandler. I am able to push down predicates for following query and this works fine. Example: select o_custkey,c_custkey from customer,orders where c_mktsegment = 'BUILDING'; (*column-ref = c_mktsegment comparison-op = op constant-value = 'BUILDING'*) I get no results when I execute following query Example: select o_custkey,c_custkey from customer,orders where c_mktsegment = 'BUILDING' and c_custkey = o_custkey limit 10; in this case (*column-ref = c_mktsegment comparison-op = op constant-value = 'BUILDING'*) is evaluated by my storageHandler. While (*column-ref = c_custkey comparison-op = op constant-value = o_custkey*) is evaluated by hive. Does such kind of query work with non native tables with predicate push down or am I missing anything? Does any custom StorageHandler like HBaseStorageHandler, AccumuloStorageHandler, CassandraStorageHandler etc. support such kind of predicate push down. Thanks and Regards, Amey --001a11393f54b9de82052ca9b8ca--