drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chunhui-shi <...@git.apache.org>
Subject [GitHub] drill pull request #1032: DRILL-5089: Dynamically load schema of storage plu...
Date Fri, 10 Nov 2017 06:22:38 GMT
GitHub user chunhui-shi opened a pull request:

    https://github.com/apache/drill/pull/1032

    DRILL-5089: Dynamically load schema of storage plugin only when neede…

    …d for every query
    
    For each query, loading all storage plugins and loading all workspaces under file system
plugins is not needed.
    
    This patch use DynamicRootSchema as the root schema for Drill. Which loads correspondent
storage only when needed.
    
    infoschema to read full schema information and load second level schema accordingly.
    
    for workspaces under the same Filesyetm, no need to create FileSystem for each workspace.
    
    use fs.access API to check permission which is available after HDFS 2.6 except for windows
+ local file system case.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/chunhui-shi/drill DRILL-5089-pull

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/1032.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1032
    
----
commit a381677c59a7371733bae12ad4896b7cc927da5e
Author: chunhui-shi <cshi@maprtech.com>
Date:   2017-11-03T00:06:25Z

    DRILL-5089: Dynamically load schema of storage plugin only when needed for every query
    
    For each query, loading all storage plugins and loading all workspaces under file system
plugins is not needed.
    
    This patch use DynamicRootSchema as the root schema for Drill. Which loads correspondent
storage only when needed.
    
    infoschema to read full schema information and load second level schema accordingly.
    
    for workspaces under the same Filesyetm, no need to create FileSystem for each workspace.
    
    use fs.access API to check permission which is available after HDFS 2.6 except for windows
+ local file system case.

----


---

Mime
View raw message