tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yshan <ys...@gruter.com>
Subject Re: [jira] [Commented] (TAJO-337) Generic StorageManager to provide common storage methods
Date Tue, 10 Mar 2015 01:57:53 GMT
Good.
I eagerly anticipate the doc.
Thank you :)

-- Yeon-su Han / yshan@gruter.com Gruter, Inc., R&D Team 
www.gruter.com Enjoy Connecting



> 2015. 3. 10., 오전 9:39, Hyunsik Choi (JIRA) <jira@apache.org> 작성:
> 
> 
>    [ https://issues.apache.org/jira/browse/TAJO-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353981#comment-14353981
] 
> 
> Hyunsik Choi commented on TAJO-337:
> -----------------------------------
> 
> Currently, I'm writing the design draft about how I achieve this feature. I'll share
the doc soon.
> 
>> Generic StorageManager to provide common storage methods
>> --------------------------------------------------------
>> 
>>                Key: TAJO-337
>>                URL: https://issues.apache.org/jira/browse/TAJO-337
>>            Project: Tajo
>>         Issue Type: Improvement
>>         Components: catalog, storage
>>           Reporter: Hyunsik Choi
>>           Assignee: Hyunsik Choi
>> 
>> Currently, Tajo uses HDFS as a primary storage. But, as a data warehouse system,
Tajo should easily support various data sources.
>> For this, I propose a generic storage handler interface that provides common storage
methods as follows:
>> * splitting input data
>> * locality
>> * accessing catalog (if providing)
>> * creating a table
>> * removing a table
>> * adding default table properties and validating properties
>> * committing, rollback, and clean up output tables
>> * getting table physical information like table volumes and others
>> * managing connection pool for connection-based storages
>> * adding storage-specified rewrite rules
>> * adding hooks for query phases
>> * physical properties like instant random access, indexible, read throughput, and
write throughput
> 
> 
> 
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message