carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ravipesala <...@git.apache.org>
Subject [GitHub] carbondata pull request #1831: [CARBONDATA-1993] Carbon properties default v...
Date Fri, 02 Feb 2018 02:30:18 GMT
Github user ravipesala commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/1831#discussion_r165545325
  
    --- Diff: docs/configuration-parameters.md ---
    @@ -32,10 +32,10 @@ This section provides the details of all the configurations required
for the Car
     
     | Property | Default Value | Description |
     |----------------------------|-------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
    -| carbon.storelocation | /user/hive/warehouse/carbon.store | Location where CarbonData
will create the store, and write the data in its own format. NOTE: Store location should be
in HDFS. |
    -| carbon.ddl.base.hdfs.url | hdfs://hacluster/opt/data | This property is used to configure
the HDFS relative path, the path configured in carbon.ddl.base.hdfs.url will be appended to
the HDFS path configured in fs.defaultFS. If this path is configured, then user need not pass
the complete path while dataload. For example: If absolute path of the csv file is hdfs://10.18.101.155:54310/data/cnbc/2016/xyz.csv,
the path "hdfs://10.18.101.155:54310" will come from property fs.defaultFS and user can configure
the /data/cnbc/ as carbon.ddl.base.hdfs.url. Now while dataload user can specify the csv path
as /2016/xyz.csv. |
    -| carbon.badRecords.location | /opt/Carbon/Spark/badrecords | Path where the bad records
are stored. |
    -| carbon.data.file.version | 3 | If this parameter value is set to 1, then CarbonData
will support the data load which is in old format(0.x version). If the value is set to 2(1.x
onwards version), then CarbonData will support the data load of new format only. The default
value for this parameter is 3(latest version is set as default version). It improves the query
performance by ~20% to 50%. For configuring V3 format explicitly, add carbon.data.file.version
= V3 in carbon.properties file. |
    +| carbon.storelocation |  | Location where CarbonData will create the store, and write
the data in its own format. NOTE: Store location should be in HDFS. |
    --- End diff --
    
    Here also mention that if it is not specified it takes spark warehouse path


---

Mime
View raw message