carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacky Li (JIRA)" <>
Subject [jira] [Created] (CARBONDATA-284) Abstracting Index and Segment interface
Date Mon, 03 Oct 2016 16:12:21 GMT
Jacky Li created CARBONDATA-284:

             Summary: Abstracting Index and Segment interface
                 Key: CARBONDATA-284
             Project: CarbonData
          Issue Type: Improvement
          Components: hadoop-integration
    Affects Versions: 0.1.0-incubating
            Reporter: Jacky Li
             Fix For: 0.2.0-incubating

This issue is intended to abstract developer API and user API to achieve following goals:

Goal 1: User can choose the place to store Index data, it can be stored in
processing framework's memory space (like in spark driver memory) or in
another service outside of the processing framework (like using a
independent database service, which can be shared across client)

Goal 2: Developer can add more index of his choice to CarbonData files.
Besides B+ tree on multi-dimensional key which current CarbonData supports,
developers are free to add other indexing technology to make certain
workload faster. These new indices should be added in a pluggable way.

This Jira has been discussed in maillist:

This message was sent by Atlassian JIRA

View raw message