carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang Chen (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CARBONDATA-322) Integration with spark 2.x
Date Fri, 20 Jan 2017 04:06:26 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Liang Chen resolved CARBONDATA-322.
-----------------------------------
    Resolution: Fixed

> Integration with  spark 2.x 
> ----------------------------
>
>                 Key: CARBONDATA-322
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-322
>             Project: CarbonData
>          Issue Type: New Feature
>          Components: spark-integration
>    Affects Versions: 0.2.0-incubating
>            Reporter: Fei Wang
>            Assignee: Fei Wang
>             Fix For: 1.0.0-incubating
>
>
> Since spark 2.0 released. there are many nice features such as more efficient parser,
vectorized execution, adaptive execution. 
> It is good to integrate with spark 2.x
> current integration up to Spark v1.6 is tightly coupled with spark, we would like to
cleanup the interface with following design points in mind: 
> 1. decoupled with Spark, integration based on Spark's v2 datasource API
> 2. Enable vectorized carbon reader
> 3. Support saving DataFrame to Carbondata file through Carbondata's output format.
> ...



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message