carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Divya Gupta (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-619) Compaction API for Spark 2.1 : Issue in compaction type
Date Mon, 16 Jan 2017 13:03:26 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Divya Gupta updated CARBONDATA-619:
-----------------------------------
    Labels: 2.1.0 Spark  (was: )

> Compaction API for Spark 2.1 : Issue in compaction type
> -------------------------------------------------------
>
>                 Key: CARBONDATA-619
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-619
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-query
>    Affects Versions: 1.0.0-incubating
>            Reporter: DEEPAK MEHRA
>            Assignee: ravikiran
>            Priority: Minor
>         Attachments: compaction_result.png, employee.csv
>
>
> Compaction API for Spark 2.1 : Compaction is successful on the segment ids irrespective
of the compaction types which are( Minor and Major) i.e The compaction was successful for
type other than Minor/Major 
> I created a table with name carbon_table and made 5 loads into the table with the threshold
of (4,3)
> cc.sql("create table carbon_table(id int,name string) stored by 'carbondata'")
> cc.sql("LOAD DATA LOCAL INPATH 'hdfs://hadoop-master:54311/data/employee.csv'
> INTO TABLE carbon_table options('FILEHEADER'='id,name')")
> For instance 
> Compaction.compaction(spark,"default","carbon_table","xyz")
> here 
> default is the database name
> carbon_table is the table name 
> xyz is the compaction type
> I invoked the above method to compact the segments and it was executed successfully and
compacted the segment ids. On show segment It produced the result with success for compaction
. I have attached the screen shot for the same.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message