carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xuchuanyin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-1572) Support Streaming Ingest
Date Sun, 15 Oct 2017 07:47:00 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205057#comment-16205057
] 

xuchuanyin commented on CARBONDATA-1572:
----------------------------------------

[~QiangCai]
I have two questions about the design:

1.Handoff process will convert rows in Streaming-Segment into Batch-Segment ,does it means
the records will be deleted from the Streaming-segment and inserted into the batch-segment?
So what will happen when a long query is running and the handoff process is done, i.e., Query
deleted records from streaming segment and ignore inserted records from batch segment.

2. Will we implement the streaming-segment like HBase, or just put the segment on HDFS? I
perfer the first.

> Support Streaming Ingest
> ------------------------
>
>                 Key: CARBONDATA-1572
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1572
>             Project: CarbonData
>          Issue Type: New Feature
>            Reporter: QiangCai
>         Attachments: CarbonData Streaming Ingest.pdf
>
>
> CarbonData should support streaming ingest.
> [^CarbonData Streaming Ingest.pdf]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message