carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-1175) Streaming Ingest: Write path data conversion/transformation
Date Mon, 18 Sep 2017 08:56:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravindra Pesala updated CARBONDATA-1175:
----------------------------------------
    Fix Version/s:     (was: 1.2.0)
                   1.3.0

> Streaming Ingest: Write path data conversion/transformation
> -----------------------------------------------------------
>
>                 Key: CARBONDATA-1175
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1175
>             Project: CarbonData
>          Issue Type: Sub-task
>          Components: core, data-load, data-query, examples, file-format, spark-integration,
sql
>    Affects Versions: 1.2.0
>            Reporter: Aniket Adnaik
>             Fix For: 1.3.0
>
>
> Streaming Ingest: Write path Data conversion/Transformation
> - input data is a byte stream in catalyst InternalRow format (row major), which needs
to be converted to column format
> - column converter and corresponding iterators needs to be created before invoking carbon
layer load path
> - various carbon properties needs to be set, for example SORT_SCOPE (to skip sorting),
blocket size, skip global dictionary creation etc 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message