carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ravipesala <>
Subject [GitHub] incubator-carbondata pull request #412: [WIP]Added vector reader in Carbon s...
Date Thu, 08 Dec 2016 10:49:21 GMT
GitHub user ravipesala opened a pull request:

    [WIP]Added vector reader in Carbon scan.

    This PR enables carbon to read the data in vector columnar format.
    New interface classes added `CarbonColumnarBatch` and `CarbonColumnVector`  to read data
in vector format directly from scanner.
    In case of Spark2.0 batch reader we can directly pass wrapper class of 'org.apache.spark.sql.execution.vectorized.ColumnarBatch'
to carbon and set the data to it. 

You can merge this pull request into a Git repository by running:

    $ git pull vectorreader

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #412
commit 1bdf725452092b23fc50b4c8cb513541b430fae2
Author: ravipesala <>
Date:   2016-12-06T17:54:05Z

    add initial check in for vector reader

commit 6bce6a80d09a7853e3fb883a320368471d5e739a
Author: ravipesala <>
Date:   2016-12-08T10:39:44Z

    Added vector reader in carbon

commit c52f8644160a1ac7ad2531e80f3154ca893a03ad
Author: ravipesala <>
Date:   2016-12-08T10:43:34Z

    Fixed check style


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message