carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Babulal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-1953) Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table
Date Fri, 29 Dec 2017 11:49:00 GMT
Babulal created CARBONDATA-1953:
-----------------------------------

             Summary: Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding
from main table
                 Key: CARBONDATA-1953
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1953
             Project: CarbonData
          Issue Type: Bug
            Reporter: Babulal


Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table

 spark.sql("drop table if exists y ")
    spark.sql("create table y(year int,month int,name string,salary int) stored by 'carbondata'
tblproperties('NO_INVERTED_INDEX'='name','sort_scope'='Global_sort','table_blocksize'='23','Dictionary_include'='month','Dictionary_exclude'='year,name','sort_columns'='month,year,name')")
    spark.sql("insert into y select 10,11,'babu',12")


spark.sql("create datamap y1_sum1 on table y using 'preaggregate' as select year,month,name,sum(salary)
from y group by year,month,name")
    spark.sql("desc formatted y").show(100,false)
    spark.sql("desc formatted y_y1_sum1").show(100,false)



------
|col_name                            |data_type                                          
                            |comment                                                     
           |
+------------------------------------+--------------------------------------------------------------------------------+------------------------------------------------------------------------+
|y_year                              |int                                                
                            |KEY COLUMN,NOINVERTEDINDEX,null                             
           |
|y_month                             |int                                                
                            |DICTIONARY, KEY COLUMN,NOINVERTEDINDEX,null                 
           |
|y_name                              |string                                             
                            |KEY COLUMN,null                                             
           |
|y_salary_sum                        |bigint                                             
                            |MEASURE,null                                                
           |
|                                    |                                                   
                            |                                                            
           |
|##Detailed Table Information        |                                                   
                            |                                                            
           |
|Database Name                       |default                                            
                            |                                                            
           |
|Table Name                          |y_y1_sum1                                          
                            |                                                            
           |
|CARBON Store Path                   |D:\code\carbondata\myfork\incubator-carbondata/examples/spark2/target/store
    |                                                                        |
|Comment                             |                                                   
                            |                                                            
           |
|Table Block Size                    |1024 MB                                            
                            |                                                            
           |
|Table Data Size                     |1297                                               
                            |                                                            
           |
|Table Index Size                    |1076                                               
                            |                                                            
           |
|Last Update Time                    |1514546841061                                      
                            |                                                            
           |
|SORT_SCOPE                          |LOCAL_SORT                                         
                            |LOCAL_SORT                                                  
           |
|Streaming                           |false                                              
                            |                                                            
           |
|SORT_SCOPE                          |LOCAL_SORT                                         
                            





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message