carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "anubhav tarar (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CARBONDATA-691) After Compaction records count are mismatched.
Date Thu, 09 Feb 2017 06:53:41 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859080#comment-15859080
] 

anubhav tarar edited comment on CARBONDATA-691 at 2/9/17 6:53 AM:
------------------------------------------------------------------

[~Bjangir] can you please attached the csv,i tried it with different csv and laod data 5 times
result is accurate 


was (Author: anubhavtarar):
[~Bjangir] can you please attached the csv

> After Compaction records count are mismatched.
> ----------------------------------------------
>
>                 Key: CARBONDATA-691
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-691
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load, data-query, docs
>    Affects Versions: 1.0.0-incubating
>            Reporter: Babulal
>         Attachments: createLoadcmd.txt, driverlog.txt
>
>
> Spark version - Spark 1.6.2 and spark2.1 
> After Compaction data showing is wrong.
> create table and load 4 times s( compaction threshold is 4,3)
> Load 4 times same data .each load 105 records as attached in file . 
> --+--+
> | SegmentSequenceId  |   Status   |     Load Start Time      |      Load End Time   
   |
> +--------------------+------------+--------------------------+--------------------------+--+
> | 3                  | Compacted  | 2017-02-01 14:07:51.922  | 2017-02-01 14:07:52.591
 |
> | 2                  | Compacted  | 2017-02-01 14:07:33.481  | 2017-02-01 14:07:34.443
 |
> | 1                  | Compacted  | 2017-02-01 14:07:23.495  | 2017-02-01 14:07:24.167
 |
> | 0.1                | Success    | 2017-02-01 14:07:52.815  | 2017-02-01 14:07:57.201
 |
> | 0                  | Compacted  | 2017-02-01 14:07:07.541  | 2017-02-01 14:07:11.983
 |
> +--------------------+------------+--------------------------+--------------------------+--+
> 5 rows selected (0.021 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(*) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +-----------+--+
> | count(1)  |
> +-----------+--+
> | 1680      |
> +-----------+--+
> 1 row selected (4.468 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(imei) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +--------------+--+
> | count(imei)  |
> +--------------+--+
> | 1680         |
> +--------------+--+
> Expected :-  total records should be 420 . 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message