carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chenerlu <>
Subject [GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite of presto...
Date Thu, 29 Jun 2017 04:05:53 GMT
Github user chenerlu commented on a diff in the pull request:
    --- Diff: integration/presto/ ---
    @@ -59,28 +55,50 @@ Please follow the below steps to query carbondata in presto
     * config carbondata-connector for presto
    -  First:compile carbondata-presto integration module
    +  Firstly: Compile carbondata, including carbondata-presto integration module
       $ git clone
    -  $ cd carbondata/integration/presto
    -  $ mvn clean package
    +  $ cd carbondata
    +  $ mvn -DskipTests -P{spark-version} -Dspark.version={spark-version-number} -Dhadoop.version={hadoop-version-number}
clean package
    +  ```
    +  Replace the spark and hadoop version with you the version you used in your cluster.
    +  For example, if you use Spark2.1.0 and Hadoop 2.7.3, you would like to compile using:
    +  ```
    +  mvn -DskipTests -Pspark-2.1 -Dspark.version=2.1.0 -Dhadoop.version=2.7.3 clean package
    +  ```
    +  Secondly: Create a folder named 'carbondata' under $PRESTO_HOME$/plugin and
    +  copy all jar from carbondata/integration/presto/target/carbondata-presto-x.x.x-SNAPSHOT
    +        to $PRESTO_HOME$/plugin/carbondata
    +  Thirdly: Create a file under $PRESTO_HOME$/etc/catalog/ containing
the following contents:
    -  Second:create one folder "carbondata" under ./presto-server-0.166/plugin
    -  Third:copy all jar from ./carbondata/integration/presto/target/carbondata-presto-x.x.x-SNAPSHOT
    -        to ./presto-server-0.166/plugin/carbondata
    +  carbondata-store={schema-store-path}
    +  ```
    +  Replace the schema-store-path with the absolute path the directory which is the parent
of the schema.
    +  For example, if you have a schema named 'default' stored under hdfs://namenode:9000/test/carbondata/,
    +  Then set carbondata-store=hdfs://namenode:9000/test/carbondata
    +  If you changed the jar balls or configuration files, make sure you have dispatch the
new jar balls
    +  and configuration file to all the presto nodes and restart the nodes in the cluster.
A modification of the
    +  carbondata connector will not take an effect automatically.
     ### Generate CarbonData file
    -Please refer to quick start :
    +Please refer to quick start:
    +Load data statement in Spark can be used to create carbondata tables. And you can easily
find the creaed
    --- End diff --
    created -> created

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message