Mailing-List: contact issues-help@carbondata.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@carbondata.incubator.apache.org
Date: Tue, 29 Nov 2016 15:32:58 +0000 (UTC)
From: "Ravindra Pesala (JIRA)" <jira@apache.org>
To: issues@carbondata.incubator.apache.org
Message-ID: <JIRA.13024118.1480433552000.390136.1480433578854@Atlassian.JIRA>
In-Reply-To: <JIRA.13024118.1480433552000@Atlassian.JIRA>
References: <JIRA.13024118.1480433552000@Atlassian.JIRA> <JIRA.13024118.1480433552013@arcas>
Subject: [jira] [Created] (CARBONDATA-466) Implement bucketing table in
 carbondata
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 29 Nov 2016 15:33:03 -0000

Ravindra Pesala created CARBONDATA-466:
------------------------------------------

             Summary: Implement bucketing table in carbondata
                 Key: CARBONDATA-466
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-466
             Project: CarbonData
          Issue Type: New Feature
            Reporter: Ravindra Pesala


Bucketing is the useful feature when user wants to join big tables. And also it is useful in driver level partition pruning to improve query performance.
User can add buckets on any dimension column (except complex types) as follows
{code}
CREATE TABLE test(user_id BIGINT, firstname STRING, lastname STRING)
CLUSTERED BY(user_id) INTO 32 BUCKETS
STORED BY 'carbondata';
{code}
In the above example column user_id is hash partitioned and creates 32 bucket files in carbondata. So while doing the join with other table on bucketed column it can select same buckets and do the join with out shuffling.

Carbon format changes
1. Bucketing information needs to be stored inside schema thrift file
2. Bucket id can be stored inside every carbondata index file.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)