carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ajeet Rai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-1754) Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if insert overwrite job is running concurrently
Date Fri, 17 Nov 2017 08:59:00 GMT
Ajeet Rai created CARBONDATA-1754:
-------------------------------------

             Summary: Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run
time if insert overwrite job is running concurrently
                 Key: CARBONDATA-1754
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1754
             Project: CarbonData
          Issue Type: Bug
          Components: data-load
    Affects Versions: 1.3.0
         Environment: 3 Node ant cluster
            Reporter: Ajeet Rai


Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if insert overwrite
job is running concurrently.

Steps: 
1: Create a table
2: Start three load one by one
3: After load is completed, start insert overwrite and minor compaction concurrently from
two different session
4: observe that both jobs are are running
5: Observe that Insert overwrite job is success but after that compaction fails with below
exception:
| ERROR | [pool-23-thread-49] | Error running hive query:  | org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException: Compaction failed.
Please check logs for more info. Exception in compaction java.lang.Exception: Compaction failed
to update metadata for table ajeet.flow_carbon_new999

7: Ideally compaction job should give error with message that insert overwrite in  progress.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message