flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From godfreyhe <...@git.apache.org>
Subject [GitHub] flink pull request #4667: [FLINK-5859] [table] Add PartitionableTableSource ...
Date Thu, 14 Sep 2017 06:34:59 GMT
GitHub user godfreyhe opened a pull request:


    [FLINK-5859] [table] Add PartitionableTableSource for partition pruning

    ## What is the purpose of the change
    This pull request adds PartitionableTableSource for partition pruning when optimizing
the query plan. That way both query optimization time and execution time can be reduced obviously,
especially for a large partitioned table.
    ## Brief change log
      - *Adds PartitionableTableSource which extends FilterableTableSource*
      - *Adds setRelBuilder method in FilterableTableSource class*
      - *Adds implementation for partition pruning and extracting partition predicates*
    ## Verifying this change
    This change added tests and can be verified as follows:
      - *Added integration tests for PartitionableTableSource on batch and stream sql*
      - *Added test that validates the correct of partition pruning*
      - *Added test that validates the correct of extracting partition predicates*
    ## Does this pull request potentially affect one of the following parts:
      - Dependencies (does it add or upgrade a dependency): (no)
      - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
      - The serializers: (no)
      - The runtime per-record code paths (performance sensitive): (no)
      - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing,
Yarn/Mesos, ZooKeeper: (no)
    ## Documentation
      - Does this pull request introduce a new feature? (yes)
      - If yes, how is the feature documented? (JavaDocs)

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/godfreyhe/flink FLINK-5859

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4667
commit 2fc5f9d6e6a1625a0d7784d320f8dde5df8a7f5e
Author: godfreyhe <godfreyhe@163.com>
Date:   2017-09-14T06:00:54Z

    [FLINK-5859] [table] Add PartitionableTableSource for partition pruning



View raw message