tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dongjoon Hyun <dongjoon.h...@gmail.com>
Subject Re: [DISCUSSION] Beyond 0.10.0 release
Date Mon, 16 Mar 2015 22:02:36 GMT
Thank you very much for your confirmation. 

I have three more questions.

- Is there a candidate release date for 0.11.0?
  (As a user, I love the way if Ububtu OS.)
- Cloud you give us a guideline to distinguish 0.11.0 and 0.12.0 feature?
  (Focus? or Importance?)

Warmly,
Dongjoon. 



On Mar 17, 2015, at 6:48 AM, Hyunsik Choi <hyunsik@apache.org> wrote:

Hi Dongjoon,

Of course, we will update the roadmap wiki after our discussion.

Thank you for suggesting features. All features you mentioned are on
our roadmap.
If someone started these issues and can finish in time,  they can be
included in 0.11 release.

Some issues look in progress. I checked the issues you mentioned, and
I leave some comments here.
* Keuntae just started to TAJO-921.
* TPC-DS unit tests look useful. We can add them to our unit tests in
order to verify the correctness of those kinds of queries. BTW, there
is no jira for it, and we need to create it.
* WITH clause : Any progress is invisible. we need to create it.
Someone should start it not lately.

Yarn support is also on our roadmap. Please refer to TAJO-773.
Regarding authentication and security, we need to investigate it and
its around stuff more.
Sentry and Ranger may be some candidates. Besides, we can choose other choice.

Best regards,
Hyunsik

> On Mon, Mar 16, 2015 at 5:23 AM, Dongjoon Hyun <dongjoon@apache.org> wrote:
> Hi, Hyunsik.
> 
> As a user and a member of community, thank you for all your efforts to show
> us a predictable Tajo Vision. At the end of this discussion, could you
> update Tajo Roadmap Wiki as a result? That will lead us in a more
> synergetic way. (
> https://cwiki.apache.org/confluence/display/TAJO/Tajo+Roadmap )
> 
> To all,
> Is it possible to include the following features to be completed at this
> time.
> 1. WITH clause support (for TPC-DS)
>    I expect the subquery feature will enable this easier than now.
> 2. STDDEV_POP, STDDEV_SAMP support (for TPC-DS)
>    https://issues.apache.org/jira/browse/TAJO-921
> 3. Unit Tests with TPC-DS
>    For more stable Tajo, I think Tajo need more testcases.
> 
> By the way, according to the Tajo Roadmap wiki, I think @hyunsik mentioned
> almost items there except the followings.
> - YARN Support
> - Security (Basic User Authentication) - Apache Sentry??
> 
> Does Tajo have a plan for these two items?
> 
> Best regards,
> Dongjoon.
> 
>> On Mon, Mar 16, 2015 at 8:41 PM, Jihoon Son <jihoonson@apache.org> wrote:
>> 
>> I mean, it will be possible to include the index feature to 0.11 release.
>> 
>> Best,
>> Jihoon
>> 2015년 3월 16일 (월) 오후 8:37, Jihoon Son <jihoonson@apache.org>님이
작성:
>> 
>>> I'd like to merge the index_support branch into the master.
>>> I think it would be enough to be merged if two more issues are resolved.
>>> 
>>> Sincerely,
>>> Jihoon
>>> 
>>> 
>>>> On Mon, Mar 16, 2015 at 8:31 PM Jaehwa Jung <blrunner@apache.org> wrote:
>>>> 
>>>> Hi Hyunsik
>>>> 
>>>> I totally agree with you.
>>>> 
>>>> And if possible, could you add some examples for pluggable storage? For
>>>> example, we're already working it such as, kafka, elasticsearch,
>>>> cassandra.
>>>> 
>>>> Cheers
>>>> Jaehwa
>>>> 2015. 3. 16. 오후 8:13에 "Hyunsik Choi" <hyunsik@apache.org>님이
작성:
>>>> 
>>>>> Hi folks,
>>>>> 
>>>>> In order to share milestones with you guys and concentrate our effort
>>>>> on the next release, we need to discuss the next roadmap.
>>>>> Particularly, I'd like to share our direction with new contributors
>>>>> due to the growing number of contributors.
>>>>> 
>>>>> As far as I know, the following major issues seem to be resolved in
>>>> time.
>>>>> 
>>>>> * Nested complex type (https://issues.apache.org/jira/browse/TAJO-721
>> )
>>>>> * in subquery (https://issues.apache.org/jira/browse/TAJO-680)
>>>>> * Resource allocation should be fine grained (TAJO-1397)
>>>>> * ALTER TABLE ADD/DROP PARTITION statement (TAJO-744)
>>>>> * Python UDF (TAJO-1344)
>>>>> 
>>>>> The above issues probably can be included in 0.11 release. If there
>>>>> are missed issues, please let me know them.
>>>>> 
>>>>> 
>>>>> Besides, the following feature issues may be on our roadmap:
>>>>> 
>>>>> * Multi-tenancy query scheduler (TAJO-540)
>>>>> * More SQL features (scalar subquery, ...)
>>>>>  * Decimal type support
>>>>>  * Scalar subquery
>>>>> * OLAP features (rollup, drill down, cube, ..)
>>>>> * More rewrite rules (lots of issues like Unnesting of Nested
>>>> Subqueries,
>>>>> ...)
>>>>> * Make storage handler more pluggable
>>>>> * Better failure handling of tasks and nodes (TAJO-1214)
>>>>> * CREATE FUNCTION statement support
>>>>> * CREATE TYPE statement support
>>>>> * ....
>>>>> 
>>>>> Most of them are not assigned as far as I know. In addition, there are
>>>>> many performance issues. I'll describe them later.
>>>>> 
>>>>> Anyway, I would be pleasure if we task about what issues you are
>>>>> considering for 0.11 release or after that. I'm looking forward to
>>>>> hearing you guys' feedback.
>>>>> 
>>>>> 
>>>>> Best regards,
>>>>> Hyunsik
>> 

Mime
View raw message