tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dongjoon Hyun <dongj...@apache.org>
Subject Re: TPC-DS docs for Tajo Wiki
Date Mon, 09 Mar 2015 06:31:14 GMT
Thank you, Hyunsik and Jihoon.

For your suggestion, I totally agree with you. Tajo must handle the
original queries of TPC-DS.
Fortunately, I generated those queries from TPC-DS by myself.
(I studied and referred Cloudera and Hortonworks, but I do not use their
modified queries)

I used the following commands with official TPC-DS tools in
"TPCDSVersion1.3.1/dbgen2" folder,

for i in {1..99}; do ./dsqgen -template query$i.tpl -directory
../query_templates -dialect netezza -scale 1 -verbose; mv query_0.sql
query$i.sql; done;

I used 'netezza' dialect for 'limit' clause. It has no other side effects.
Sorry for missing the above details.

If I missed anything else, please talk to me anytime. I welcome any
feedback.

Regards,
Dongjoon.


On Mon, Mar 9, 2015 at 2:55 PM, Hyunsik Choi <hyunsik.choi@gmail.com> wrote:

> It's a great start for TPC-DS benchmark.
>
> I have one suggestion. Your seem to refer impala's TPC-DS queries.
> But, some of them are modified too much.  Later, we need to
> investigate how many original queries work in Tajo, and we need to
> reflect the original queries rather than modified ones to the wiki
> page.
>
> Warm regards,
> Hyunsik
>
> On Sun, Mar 8, 2015 at 10:47 PM, Jihoon Son <jihoonson@apache.org> wrote:
> > Looks great!
> > Thanks Dongjoon
> >
> > Best,
> > Jihoon
> > 2015년 3월 9일 (월) 오후 2:38, Dongjoon Hyun <dongjoon@apache.org>님이
작성:
> >
> >> I created and filled the following page according to my file.
> >>
> >> https://cwiki.apache.org/confluence/display/TAJO/TPC-DS+Benchmark+Set
> >>
> >> Thank you, Hyunsik.
> >>
> >> Best regards,
> >> Dongjoon.
> >>
> >> On Mon, Mar 9, 2015 at 1:51 PM, Hyunsik Choi <hyunsik@apache.org
> >> <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>> wrote:
> >>
> >> > I just gave your account the privileges. You can create or edit wiki
> >> pages
> >> > now.
> >> >
> >> > Best regards,
> >> > Hyunsik
> >> >
> >> > On Sun, Mar 8, 2015 at 9:49 PM, Dongjoon Hyun <dongjoon@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>> wrote:
> >> > > Thanks, Jihoon. :)
> >> > >
> >> > > Regards,
> >> > > Dongjoon.
> >> > >
> >> > > 2015년 3월 9일 월요일, Jihoon Son<jihoonson@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>>님이
작성한 메시지:
> >> > >
> >> > >> Thanks Hyunsik.
> >> > >> That's the best way I think.
> >> > >>
> >> > >> Dongjoon,
> >> > >> I read your document carefully, and looks good.
> >> > >> Currently, I don't have any comments.
> >> > >> Please go ahead!
> >> > >>
> >> > >> Regards,
> >> > >> Jihoon
> >> > >>
> >> > >> On Mon, Mar 9, 2015 at 1:30 PM Dongjoon Hyun <dongjoon@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> >> > >> <javascript:;>> wrote:
> >> > >>
> >> > >> > Hi, Hyunsik.
> >> > >> >
> >> > >> > Thank you. If you do so, I will create and update TPC-DS
page.
> My id
> >> > is
> >> > >> > dongjoon.
> >> > >> >
> >> > >> > Regards,
> >> > >> > Dongjoon.
> >> > >> >
> >> > >> > On Mon, Mar 9, 2015 at 1:18 PM, Hyunsik Choi <hyunsik@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>
> >> > >> <javascript:;>
> >> > >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>
> <javascript:;>');>>
> >> > >> wrote:
> >> > >> >
> >> > >> > > Hi Dongjoon,
> >> > >> > >
> >> > >> > > Thank you for your work. The work looks nice. Do you
have a
> wiki
> >> > >> > > account? If so, please let me know your account. I'll
give
> proper
> >> > >> > > privileges to your account, allowing you to edit the
wiki
> pages.
> >> It
> >> > >> > > would be great if you continue to update the TPC-DS
pages.
> >> > >> > >
> >> > >> > > If you don't have a wiki account, you can easily create
the
> >> account
> >> > at
> >> > >> > > https://cwiki.apache.org/confluence/signup.action
> >> > >> > >
> >> > >> > > Best regards,
> >> > >> > > Hyunsik
> >> > >> > >
> >> > >> > > On Sun, Mar 8, 2015 at 5:54 PM, Jihoon Son <
> jihoonson@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
> >> > >> <javascript:;>
> >> > >> > > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
> >> <javascript:;>');>>
> >> > >> wrote:
> >> > >> > > > Thanks for sharing.
> >> > >> > > > It doesn't matter via whatever sharing tools you
use.
> >> > >> > > > I just think that Jira can be a good candidate
for sharing.
> >> > >> > > >
> >> > >> > > > Anyway, it looks good in overall. I'll left some
comments.
> >> > >> > > >
> >> > >> > > > Regards,
> >> > >> > > > Jihoon
> >> > >> > > >
> >> > >> > > > 2015년 3월 9일 (월) 오전 9:16, Dongjoon Hyun
> >> > >> > > > dongjoon@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');> <javascript:;>
> >> > >> > > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> >> > <javascript:;>');>>님이
> >> > >> 작성:
> >> > >> > > >
> >> > >> > > > Thank you, Jihoon.
> >> > >> > > >>
> >> > >> > > >> By the way, Tajo wiki is not managed by Git.
I thought this
> is
> >> > not a
> >> > >> > > patch.
> >> > >> > > >> Here is the file.
> >> > >> > > >>
> >> > >> > > >> Google Drive
> >> > >> > > >>
> >> > >> > > >> tpcds.rst
> >> > >> > > >> <
> https://docs.google.com/file/d/0B6ZxA8hLu4UIUVAtbE5maTVjWFk/
> >> > >> > > >> edit?usp=drivesdk>
> >> > >> > > >>
> >> > >> > > >>
> >> > >> > > >> Box (tpcds.txt, the same file with the above)
> >> > >> > > >>
> >> > >> > > >> https://app.box.com/s/g0w051zgh09wsa982klp6nqgow709ssk
> >> > >> > > >>
> >> > >> > > >> TPC-DS is very heavy benchmark including updating
the DW
> tables
> >> > from
> >> > >> > > >> original source tables. This file does not
cover that kind
> >> > updating
> >> > >> > > part.
> >> > >> > > >> It's a beginning of Tajo for official supporting
TPC-DS.
> >> > >> > > >>
> >> > >> > > >> I have a plan to focus TPC-DS with Tajo for
a while. I
> >> appreciate
> >> > >> any
> >> > >> > > >> comments.
> >> > >> > > >>
> >> > >> > > >> Thank you again, Jihoon.
> >> > >> > > >>
> >> > >> > > >> Regards,
> >> > >> > > >> Dongjoon.
> >> > >> > > >>
> >> > >> > > >> 2015년 3월 9일 월요일,
> >> > >> > > >> Jihoon Son<jihoonson@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');> <javascript:;>
> >> > >> > > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
> >> > <javascript:;>');>>님이
> >> > >> 작성한 메시지:
> >> > >> > > >>
> >> > >> > > >> > Good idea.
> >> > >> > > >> > I can help you to reflect your patch.
> >> > >> > > >> > Would you share it with us?
> >> > >> > > >> > I think Jira is good for sharing.
> >> > >> > > >> >
> >> > >> > > >> > Best regards,
> >> > >> > > >> > Jihoon
> >> > >> > > >> > 2015년 3월 9일 (월) 오전 8:05, Dongjoon
Hyun <
> dongjoon@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> >> > >> <javascript:;>
> >> > >> > > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org
> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> <javascript:;>');>
> >> > >> > > >> <javascript:;>>님이
> >> > >> > > >> > 작성:
> >> > >> > > >> >
> >> > >> > > >> > > Hi,
> >> > >> > > >> > >
> >> > >> > > >> > > TPC-DS is becoming more popular.
It is in the Tajo
> Roadmap
> >> > also
> >> > >> > and
> >> > >> > > >> > > several related issues are already
created and closed in
> >> Tajo
> >> > >> > Jira.
> >> > >> > > >> So, I
> >> > >> > > >> > > made TPC-DS rst file for Tajo wiki
during last weekend.
> I
> >> > think
> >> > >> it
> >> > >> > > will
> >> > >> > > >> > be
> >> > >> > > >> > > helpful for other Tajo users preparing
TPC-DS in the
> >> future.
> >> > >> > > >> > >
> >> > >> > > >> > > Could anyone review this and update
Tajo wiki (maybe,
> >> > benchmark
> >> > >> > > >> section)?
> >> > >> > > >> > > I prepared this file in the same
style with TPC-H in
> Tajo
> >> > wiki.
> >> > >> > > >> > >
> >> > >> > > >> > > Warmly,
> >> > >> > > >> > > Dongjoon.
> >> > >> > > >> > >
> >> > >> > > >> >
> >> > >> > > >>
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message