tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jihun Kang <ji...@apache.org>
Subject Re: TPC-DS docs for Tajo Wiki
Date Mon, 09 Mar 2015 08:53:48 GMT
Great work! This documentation would be a good starting point for users who
want to run benchmarks on Apache Tajo.

2015-03-09 15:36 GMT+09:00 Hyunsik Choi <hyunsik@apache.org>:

> Thank you for your comment. Sounds nice to me. Please go head!
>
> On Sun, Mar 8, 2015 at 11:31 PM, Dongjoon Hyun <dongjoon@apache.org>
> wrote:
> > Thank you, Hyunsik and Jihoon.
> >
> > For your suggestion, I totally agree with you. Tajo must handle the
> > original queries of TPC-DS.
> > Fortunately, I generated those queries from TPC-DS by myself.
> > (I studied and referred Cloudera and Hortonworks, but I do not use their
> > modified queries)
> >
> > I used the following commands with official TPC-DS tools in
> > "TPCDSVersion1.3.1/dbgen2" folder,
> >
> > for i in {1..99}; do ./dsqgen -template query$i.tpl -directory
> > ../query_templates -dialect netezza -scale 1 -verbose; mv query_0.sql
> > query$i.sql; done;
> >
> > I used 'netezza' dialect for 'limit' clause. It has no other side
> effects.
> > Sorry for missing the above details.
> >
> > If I missed anything else, please talk to me anytime. I welcome any
> > feedback.
> >
> > Regards,
> > Dongjoon.
> >
> >
> > On Mon, Mar 9, 2015 at 2:55 PM, Hyunsik Choi <hyunsik.choi@gmail.com>
> wrote:
> >
> >> It's a great start for TPC-DS benchmark.
> >>
> >> I have one suggestion. Your seem to refer impala's TPC-DS queries.
> >> But, some of them are modified too much.  Later, we need to
> >> investigate how many original queries work in Tajo, and we need to
> >> reflect the original queries rather than modified ones to the wiki
> >> page.
> >>
> >> Warm regards,
> >> Hyunsik
> >>
> >> On Sun, Mar 8, 2015 at 10:47 PM, Jihoon Son <jihoonson@apache.org>
> wrote:
> >> > Looks great!
> >> > Thanks Dongjoon
> >> >
> >> > Best,
> >> > Jihoon
> >> > 2015년 3월 9일 (월) 오후 2:38, Dongjoon Hyun <dongjoon@apache.org>님이
작성:
> >> >
> >> >> I created and filled the following page according to my file.
> >> >>
> >> >>
> https://cwiki.apache.org/confluence/display/TAJO/TPC-DS+Benchmark+Set
> >> >>
> >> >> Thank you, Hyunsik.
> >> >>
> >> >> Best regards,
> >> >> Dongjoon.
> >> >>
> >> >> On Mon, Mar 9, 2015 at 1:51 PM, Hyunsik Choi <hyunsik@apache.org
> >> >> <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>> wrote:
> >> >>
> >> >> > I just gave your account the privileges. You can create or edit
> wiki
> >> >> pages
> >> >> > now.
> >> >> >
> >> >> > Best regards,
> >> >> > Hyunsik
> >> >> >
> >> >> > On Sun, Mar 8, 2015 at 9:49 PM, Dongjoon Hyun <dongjoon@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>>
wrote:
> >> >> > > Thanks, Jihoon. :)
> >> >> > >
> >> >> > > Regards,
> >> >> > > Dongjoon.
> >> >> > >
> >> >> > > 2015년 3월 9일 월요일, Jihoon Son<jihoonson@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>>님이
작성한 메시지:
> >> >> > >
> >> >> > >> Thanks Hyunsik.
> >> >> > >> That's the best way I think.
> >> >> > >>
> >> >> > >> Dongjoon,
> >> >> > >> I read your document carefully, and looks good.
> >> >> > >> Currently, I don't have any comments.
> >> >> > >> Please go ahead!
> >> >> > >>
> >> >> > >> Regards,
> >> >> > >> Jihoon
> >> >> > >>
> >> >> > >> On Mon, Mar 9, 2015 at 1:30 PM Dongjoon Hyun <
> dongjoon@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> >> >> > >> <javascript:;>> wrote:
> >> >> > >>
> >> >> > >> > Hi, Hyunsik.
> >> >> > >> >
> >> >> > >> > Thank you. If you do so, I will create and update
TPC-DS page.
> >> My id
> >> >> > is
> >> >> > >> > dongjoon.
> >> >> > >> >
> >> >> > >> > Regards,
> >> >> > >> > Dongjoon.
> >> >> > >> >
> >> >> > >> > On Mon, Mar 9, 2015 at 1:18 PM, Hyunsik Choi <
> hyunsik@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>
> >> >> > >> <javascript:;>
> >> >> > >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','hyunsik@apache.org');>
> >> <javascript:;>');>>
> >> >> > >> wrote:
> >> >> > >> >
> >> >> > >> > > Hi Dongjoon,
> >> >> > >> > >
> >> >> > >> > > Thank you for your work. The work looks nice.
Do you have a
> >> wiki
> >> >> > >> > > account? If so, please let me know your account.
I'll give
> >> proper
> >> >> > >> > > privileges to your account, allowing you to
edit the wiki
> >> pages.
> >> >> It
> >> >> > >> > > would be great if you continue to update the
TPC-DS pages.
> >> >> > >> > >
> >> >> > >> > > If you don't have a wiki account, you can easily
create the
> >> >> account
> >> >> > at
> >> >> > >> > > https://cwiki.apache.org/confluence/signup.action
> >> >> > >> > >
> >> >> > >> > > Best regards,
> >> >> > >> > > Hyunsik
> >> >> > >> > >
> >> >> > >> > > On Sun, Mar 8, 2015 at 5:54 PM, Jihoon Son
<
> >> jihoonson@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
> >> >> > >> <javascript:;>
> >> >> > >> > > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
> >> >> <javascript:;>');>>
> >> >> > >> wrote:
> >> >> > >> > > > Thanks for sharing.
> >> >> > >> > > > It doesn't matter via whatever sharing
tools you use.
> >> >> > >> > > > I just think that Jira can be a good candidate
for
> sharing.
> >> >> > >> > > >
> >> >> > >> > > > Anyway, it looks good in overall. I'll
left some comments.
> >> >> > >> > > >
> >> >> > >> > > > Regards,
> >> >> > >> > > > Jihoon
> >> >> > >> > > >
> >> >> > >> > > > 2015년 3월 9일 (월) 오전 9:16, Dongjoon
Hyun
> >> >> > >> > > > dongjoon@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> <javascript:;>
> >> >> > >> > > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> >> >> > <javascript:;>');>>님이
> >> >> > >> 작성:
> >> >> > >> > > >
> >> >> > >> > > > Thank you, Jihoon.
> >> >> > >> > > >>
> >> >> > >> > > >> By the way, Tajo wiki is not managed
by Git. I thought
> this
> >> is
> >> >> > not a
> >> >> > >> > > patch.
> >> >> > >> > > >> Here is the file.
> >> >> > >> > > >>
> >> >> > >> > > >> Google Drive
> >> >> > >> > > >>
> >> >> > >> > > >> tpcds.rst
> >> >> > >> > > >> <
> >> https://docs.google.com/file/d/0B6ZxA8hLu4UIUVAtbE5maTVjWFk/
> >> >> > >> > > >> edit?usp=drivesdk>
> >> >> > >> > > >>
> >> >> > >> > > >>
> >> >> > >> > > >> Box (tpcds.txt, the same file with
the above)
> >> >> > >> > > >>
> >> >> > >> > > >> https://app.box.com/s/g0w051zgh09wsa982klp6nqgow709ssk
> >> >> > >> > > >>
> >> >> > >> > > >> TPC-DS is very heavy benchmark including
updating the DW
> >> tables
> >> >> > from
> >> >> > >> > > >> original source tables. This file
does not cover that
> kind
> >> >> > updating
> >> >> > >> > > part.
> >> >> > >> > > >> It's a beginning of Tajo for official
supporting TPC-DS.
> >> >> > >> > > >>
> >> >> > >> > > >> I have a plan to focus TPC-DS with
Tajo for a while. I
> >> >> appreciate
> >> >> > >> any
> >> >> > >> > > >> comments.
> >> >> > >> > > >>
> >> >> > >> > > >> Thank you again, Jihoon.
> >> >> > >> > > >>
> >> >> > >> > > >> Regards,
> >> >> > >> > > >> Dongjoon.
> >> >> > >> > > >>
> >> >> > >> > > >> 2015년 3월 9일 월요일,
> >> >> > >> > > >> Jihoon Son<jihoonson@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
> <javascript:;>
> >> >> > >> > > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','jihoonson@apache.org');>
> >> >> > <javascript:;>');>>님이
> >> >> > >> 작성한 메시지:
> >> >> > >> > > >>
> >> >> > >> > > >> > Good idea.
> >> >> > >> > > >> > I can help you to reflect your
patch.
> >> >> > >> > > >> > Would you share it with us?
> >> >> > >> > > >> > I think Jira is good for sharing.
> >> >> > >> > > >> >
> >> >> > >> > > >> > Best regards,
> >> >> > >> > > >> > Jihoon
> >> >> > >> > > >> > 2015년 3월 9일 (월) 오전
8:05, Dongjoon Hyun <
> >> dongjoon@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> >> >> > >> <javascript:;>
> >> >> > >> > > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org
> >> >> > <javascript:_e(%7B%7D,'cvml','dongjoon@apache.org');>
> >> <javascript:;>');>
> >> >> > >> > > >> <javascript:;>>님이
> >> >> > >> > > >> > 작성:
> >> >> > >> > > >> >
> >> >> > >> > > >> > > Hi,
> >> >> > >> > > >> > >
> >> >> > >> > > >> > > TPC-DS is becoming more
popular. It is in the Tajo
> >> Roadmap
> >> >> > also
> >> >> > >> > and
> >> >> > >> > > >> > > several related issues are
already created and
> closed in
> >> >> Tajo
> >> >> > >> > Jira.
> >> >> > >> > > >> So, I
> >> >> > >> > > >> > > made TPC-DS rst file for
Tajo wiki during last
> weekend.
> >> I
> >> >> > think
> >> >> > >> it
> >> >> > >> > > will
> >> >> > >> > > >> > be
> >> >> > >> > > >> > > helpful for other Tajo users
preparing TPC-DS in the
> >> >> future.
> >> >> > >> > > >> > >
> >> >> > >> > > >> > > Could anyone review this
and update Tajo wiki (maybe,
> >> >> > benchmark
> >> >> > >> > > >> section)?
> >> >> > >> > > >> > > I prepared this file in
the same style with TPC-H in
> >> Tajo
> >> >> > wiki.
> >> >> > >> > > >> > >
> >> >> > >> > > >> > > Warmly,
> >> >> > >> > > >> > > Dongjoon.
> >> >> > >> > > >> > >
> >> >> > >> > > >> >
> >> >> > >> > > >>
> >> >> > >> > >
> >> >> > >> >
> >> >> > >>
> >> >> >
> >> >>
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message