carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xuzhiliang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-999) use carbondata bulket feature,but it doesn't seem to work?anyone know it?
Date Thu, 27 Apr 2017 08:11:04 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

xuzhiliang updated CARBONDATA-999:
----------------------------------
               Docs Text:   (was: 1.CREATE TABLE kd_shop_test(platFormId int,sellerNick string,companyGuid
STRING,companyName STRING) STORED BY 'carbondata' TBLPROPERTIES ('BUCKETNUMBER'='2','BUCKETCOLUMNS'='sellerNick')

2. hadoop dfs -lsr /Opt/CarbonStore/default/kd_shop_test
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0
-rw-r--r--   3 root supergroup        566 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493278648826.carbonindex
-rw-r--r--   3 root supergroup        891 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493278648826.carbondata
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata
-rw-r--r--   3 root supergroup        211 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dict
-rw-r--r--   3 root supergroup         12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dictmeta
-rw-r--r--   3 root supergroup         31 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16_211.sortindex
-rw-r--r--   3 root supergroup         39 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dict
-rw-r--r--   3 root supergroup         11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dictmeta
-rw-r--r--   3 root supergroup         11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c_39.sortindex
-rw-r--r--   3 root supergroup         73 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dict
-rw-r--r--   3 root supergroup         12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dictmeta
-rw-r--r--   3 root supergroup         13 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034_73.sortindex
-rw-r--r--   3 root supergroup        532 2017-04-27 15:36 /Opt/CarbonStore/default/kd_shop_test/Metadata/schema
-rw-r--r--   3 root supergroup        268 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/tablestatus

3.when loading data
the sorter is type of ParallelReadMergeSorterImpl,not ParallelReadMergeSorterWithBucketingImpl,why
configuration.getBucketingInfo is null?What is wrong with that? Can you fix it?)
    Request participants:   (was: )
             Description: 
1.CREATE TABLE kd_shop_test(platFormId int,sellerNick string,companyGuid STRING,companyName
STRING) STORED BY 'carbondata' TBLPROPERTIES ('BUCKETNUMBER'='2','BUCKETCOLUMNS'='sellerNick')

2. hadoop dfs -lsr /Opt/CarbonStore/default/kd_shop_test
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0
-rw-r--r--   3 root supergroup        566 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493278648826.carbonindex
-rw-r--r--   3 root supergroup        891 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493278648826.carbondata
drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata
-rw-r--r--   3 root supergroup        211 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dict
-rw-r--r--   3 root supergroup         12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dictmeta
-rw-r--r--   3 root supergroup         31 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16_211.sortindex
-rw-r--r--   3 root supergroup         39 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dict
-rw-r--r--   3 root supergroup         11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dictmeta
-rw-r--r--   3 root supergroup         11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c_39.sortindex
-rw-r--r--   3 root supergroup         73 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dict
-rw-r--r--   3 root supergroup         12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dictmeta
-rw-r--r--   3 root supergroup         13 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034_73.sortindex
-rw-r--r--   3 root supergroup        532 2017-04-27 15:36 /Opt/CarbonStore/default/kd_shop_test/Metadata/schema
-rw-r--r--   3 root supergroup        268 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/tablestatus

3.when loading data
the sorter is type of ParallelReadMergeSorterImpl,not ParallelReadMergeSorterWithBucketingImpl,why
configuration.getBucketingInfo is null?What is wrong with that? Can you fix it?

  was:use carbondata bulket feature,but it doesn't seem to work?anyone know it?


> use carbondata bulket feature,but it doesn't seem to work?anyone know it?
> -------------------------------------------------------------------------
>
>                 Key: CARBONDATA-999
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-999
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 1.1.0
>         Environment: spark 1.6.2,carbondata 1.1.0
>            Reporter: xuzhiliang
>
> 1.CREATE TABLE kd_shop_test(platFormId int,sellerNick string,companyGuid STRING,companyName
STRING) STORED BY 'carbondata' TBLPROPERTIES ('BUCKETNUMBER'='2','BUCKETCOLUMNS'='sellerNick')
> 2. hadoop dfs -lsr /Opt/CarbonStore/default/kd_shop_test
> drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact
> drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0
> drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0
> -rw-r--r--   3 root supergroup        566 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493278648826.carbonindex
> -rw-r--r--   3 root supergroup        891 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493278648826.carbondata
> drwxr-xr-x   - root supergroup          0 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata
> -rw-r--r--   3 root supergroup        211 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dict
> -rw-r--r--   3 root supergroup         12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16.dictmeta
> -rw-r--r--   3 root supergroup         31 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/472c32a7-db92-48d9-b2d8-c3b594a92f16_211.sortindex
> -rw-r--r--   3 root supergroup         39 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dict
> -rw-r--r--   3 root supergroup         11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c.dictmeta
> -rw-r--r--   3 root supergroup         11 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/7010a4ff-5575-42b9-949c-6456d683da0c_39.sortindex
> -rw-r--r--   3 root supergroup         73 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dict
> -rw-r--r--   3 root supergroup         12 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034.dictmeta
> -rw-r--r--   3 root supergroup         13 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/bcdb18a6-ff24-4992-9d43-d39cb46c4034_73.sortindex
> -rw-r--r--   3 root supergroup        532 2017-04-27 15:36 /Opt/CarbonStore/default/kd_shop_test/Metadata/schema
> -rw-r--r--   3 root supergroup        268 2017-04-27 15:37 /Opt/CarbonStore/default/kd_shop_test/Metadata/tablestatus
> 3.when loading data
> the sorter is type of ParallelReadMergeSorterImpl,not ParallelReadMergeSorterWithBucketingImpl,why
configuration.getBucketingInfo is null?What is wrong with that? Can you fix it?



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message