carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-2) Remove kettle for loading data
Date Fri, 07 Oct 2016 17:32:21 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15555705#comment-15555705
] 

ASF GitHub Bot commented on CARBONDATA-2:
-----------------------------------------

GitHub user ravipesala opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/215

    [WIP][CARBONDATA-2] Remove kettle from carbodata

    New flow is added in processing module to load data with out kettle. New code is added
to the package `org.apache.carbondata.processing.newflow` , old code (kettle framework) will
be removed once all performance comparisons are met.
    
    This is work in progress PR and not in working condition. All interfaces and related code
is added but need to be tested. 
    
    Main interfaces for loading the data.
    `org.apache.carbondata.processing.newflow.DataLoadProcessorStep`
    `org.apache.carbondata.processing.newflow.dictionarygenerator.ColumnDictionaryGenerator`
    `org.apache.carbondata.processing.newflow.encoding.RowEncoder`
    `org.apache.carbondata.processing.newflow.parser.GenericParser`


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/ravipesala/incubator-carbondata remove-kettle

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/215.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #215
    
----
commit 376933cefe5f2f241af460829373d7e9b381322d
Author: ravipesala <ravi.pesala@gmail.com>
Date:   2016-06-05T17:08:22Z

    WIP interfaces created

commit abc6f489cfb84e5697adff3494b34873dc70a434
Author: ravipesala <ravi.pesala@gmail.com>
Date:   2016-09-08T19:14:39Z

    Added interfaces for data loading

commit 0922915035b1c016f1b82556025d34846ee598c4
Author: ravipesala <ravi.pesala@gmail.com>
Date:   2016-09-20T10:28:54Z

    [WIP]Added interfaces for data loading

commit 1f1500adbb7097bc69eaa2238da0939933c298b3
Author: ravipesala <ravi.pesala@gmail.com>
Date:   2016-10-04T14:34:58Z

    Updated package and added sort step

commit 5625bf9433488d5acd4b37e30dbc8751dc8a0e1e
Author: ravipesala <ravi.pesala@gmail.com>
Date:   2016-10-07T09:04:28Z

    Added writer step

commit 99fd9f7f117b8221a0fced62678da35239a7d2a0
Author: ravipesala <ravi.pesala@gmail.com>
Date:   2016-10-07T17:14:23Z

    Added comments

----


> Remove kettle for loading data
> ------------------------------
>
>                 Key: CARBONDATA-2
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: ChenLiang
>            Priority: Critical
>             Fix For: 0.2.0-incubating
>
>
> Remove kettle for loading data module



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message