carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rahul Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-2137) Delete query is taking more time while processing the carbondata.
Date Tue, 06 Feb 2018 12:27:00 GMT
Rahul Kumar created CARBONDATA-2137:
---------------------------------------

             Summary: Delete query is taking more time while processing the carbondata.
                 Key: CARBONDATA-2137
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2137
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Rahul Kumar
            Assignee: Rahul Kumar


*Expected Output* : Delete query should take less time

*Actual Output* : Delete Query is taking 20min

*Following the steps to reproduce :* 
 * create table and load 500 million records
 * create hive table with 10% of data
 * delete the data in main-table using hive table
 * check the performance

*Following is the configuration used :*
 * SPARK_EXECUTOR_MEMORY : 200G
 * SPARK_DRIVER_MEMORY : 20G
 * SPARK_EXECUTOR_CORES : 32
 * SPARK_EXECUTOR_INSTANCEs : 3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message