Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9110A200BD5 for ; Thu, 8 Dec 2016 11:49:43 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 8FB63160B1F; Thu, 8 Dec 2016 10:49:43 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DAAAA160B1E for ; Thu, 8 Dec 2016 11:49:42 +0100 (CET) Received: (qmail 46333 invoked by uid 500); 8 Dec 2016 10:49:42 -0000 Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@carbondata.incubator.apache.org Delivered-To: mailing list issues@carbondata.incubator.apache.org Received: (qmail 46324 invoked by uid 99); 8 Dec 2016 10:49:42 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2016 10:49:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B0F8BC2778 for ; Thu, 8 Dec 2016 10:49:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -7.018 X-Spam-Level: X-Spam-Status: No, score=-7.018 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id yFoOcmC3dd6X for ; Thu, 8 Dec 2016 10:49:41 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 2FD355FB8D for ; Thu, 8 Dec 2016 10:49:39 +0000 (UTC) Received: (qmail 45918 invoked by uid 99); 8 Dec 2016 10:49:21 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2016 10:49:21 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 7FDA0E040F; Thu, 8 Dec 2016 10:49:21 +0000 (UTC) From: ravipesala To: issues@carbondata.incubator.apache.org Reply-To: issues@carbondata.incubator.apache.org Message-ID: Subject: [GitHub] incubator-carbondata pull request #412: [WIP]Added vector reader in Carbon s... Content-Type: text/plain Date: Thu, 8 Dec 2016 10:49:21 +0000 (UTC) archived-at: Thu, 08 Dec 2016 10:49:43 -0000 GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/412 [WIP]Added vector reader in Carbon scan. This PR enables carbon to read the data in vector columnar format. New interface classes added `CarbonColumnarBatch` and `CarbonColumnVector` to read data in vector format directly from scanner. In case of Spark2.0 batch reader we can directly pass wrapper class of 'org.apache.spark.sql.execution.vectorized.ColumnarBatch' to carbon and set the data to it. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ravipesala/incubator-carbondata vectorreader Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/412.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #412 ---- commit 1bdf725452092b23fc50b4c8cb513541b430fae2 Author: ravipesala Date: 2016-12-06T17:54:05Z add initial check in for vector reader commit 6bce6a80d09a7853e3fb883a320368471d5e739a Author: ravipesala Date: 2016-12-08T10:39:44Z Added vector reader in carbon commit c52f8644160a1ac7ad2531e80f3154ca893a03ad Author: ravipesala Date: 2016-12-08T10:43:34Z Fixed check style ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---