Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9D5AA200C60 for ; Mon, 24 Apr 2017 12:36:58 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 9BE78160BA5; Mon, 24 Apr 2017 10:36:58 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E434B160B99 for ; Mon, 24 Apr 2017 12:36:57 +0200 (CEST) Received: (qmail 98594 invoked by uid 500); 24 Apr 2017 10:36:56 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 98579 invoked by uid 99); 24 Apr 2017 10:36:55 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Apr 2017 10:36:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id B71CA18028D for ; Mon, 24 Apr 2017 10:36:54 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.021 X-Spam-Level: X-Spam-Status: No, score=-4.021 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 0IL1uROMLO9s for ; Mon, 24 Apr 2017 10:36:53 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id EF7645FC4D for ; Mon, 24 Apr 2017 10:36:52 +0000 (UTC) Received: (qmail 98284 invoked by uid 99); 24 Apr 2017 10:36:52 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Apr 2017 10:36:52 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 09933E0FE7; Mon, 24 Apr 2017 10:36:52 +0000 (UTC) From: ramkrish86 To: issues@flink.incubator.apache.org Reply-To: issues@flink.incubator.apache.org Message-ID: Subject: [GitHub] flink pull request #3760: FLINK-5752 Support push down projections for HBase... Content-Type: text/plain Date: Mon, 24 Apr 2017 10:36:52 +0000 (UTC) archived-at: Mon, 24 Apr 2017 10:36:58 -0000 GitHub user ramkrish86 opened a pull request: https://github.com/apache/flink/pull/3760 FLINK-5752 Support push down projections for HBaseTableSource (Ram) Ran mvn clean verify -DskipTests In this patch `Arrays.sort(nestedFields[i]);` Am doing this before doing addColumns for the new projected table source, because here the cols appears in a reverse sorted way and when we apply that for the new projected table source it creates an assertion error while creating the new calcite program with the projected cols `assert expr.getType().getFieldList().get(field.getIndex()) == field;` So doing this sort helps in correcting those issues and the tests run fine. But this nestedFields that is being passed to the projectNestedFields() API is created by `def getProjectedFields: Array[Array[String]] ` under RexProgramExtractor. Trying to understand what it does. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ramkrish86/flink FLINK-5752 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/3760.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3760 ---- commit 1885b0c9afc7aa49747987b0508ba82002a1bc8d Author: Ramkrishna Date: 2017-04-24T10:23:08Z FLINK-5752 Support push down projections for HBaseTableSource (Ram) ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---