carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Babulal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-691) After Compaction records count are mismatched.
Date Wed, 01 Feb 2017 08:50:51 GMT
Babulal created CARBONDATA-691:
----------------------------------

             Summary: After Compaction records count are mismatched.
                 Key: CARBONDATA-691
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-691
             Project: CarbonData
          Issue Type: Bug
          Components: data-load, data-query, docs
    Affects Versions: 1.0.0-incubating
            Reporter: Babulal
         Attachments: createLoadcmd.txt, driverlog.txt

Spark version - Spark 1.6.2 and spark2.1 

After Compaction data showing is wrong.

create table and load 4 times s( compaction threshold is 4,3)
Load 4 times same data .each load 105 records as attached in file . 


--+--+
| SegmentSequenceId  |   Status   |     Load Start Time      |      Load End Time       |
+--------------------+------------+--------------------------+--------------------------+--+
| 3                  | Compacted  | 2017-02-01 14:07:51.922  | 2017-02-01 14:07:52.591  |
| 2                  | Compacted  | 2017-02-01 14:07:33.481  | 2017-02-01 14:07:34.443  |
| 1                  | Compacted  | 2017-02-01 14:07:23.495  | 2017-02-01 14:07:24.167  |
| 0.1                | Success    | 2017-02-01 14:07:52.815  | 2017-02-01 14:07:57.201  |
| 0                  | Compacted  | 2017-02-01 14:07:07.541  | 2017-02-01 14:07:11.983  |
+--------------------+------------+--------------------------+--------------------------+--+
5 rows selected (0.021 seconds)





0: jdbc:hive2://8.99.61.4:23040> select count(*) from Comp_VMALL_DICTIONARY_INCLUDE_7;
+-----------+--+
| count(1)  |
+-----------+--+
| 1680      |
+-----------+--+
1 row selected (4.468 seconds)

0: jdbc:hive2://8.99.61.4:23040> select count(imei) from Comp_VMALL_DICTIONARY_INCLUDE_7;
+--------------+--+
| count(imei)  |
+--------------+--+
| 1680         |
+--------------+--+



Expected :-  total records should be 420 . 





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message