tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Azuryy Yu <azury...@gmail.com>
Subject Re: Tajo Console display issue
Date Fri, 06 Mar 2015 01:24:32 GMT
Sure, I will check 0.10 in the next week. and post back.


On Thu, Mar 5, 2015 at 7:10 PM, Jihoon Son <ghoonson@gmail.com> wrote:

> Do you mean the problem of that the progress sometimes falls?
> Basically, it can happen due to the task failures. However, it seems that
> we have another problem on progress estimation while processing queries on
> partitioned tables.
> I'll investigate the problem.
>
> We will release the version 0.10, soon. I expect it will be the next
> Monday.
> Maybe, the problem has been fixed in the new version. Would you check again
> with 0.10?
>
> Sincerely,
> Jihoon
>
>
> 2015년 3월 5일 (목) 오후 7:12, Azuryy Yu
> azuryyyu@gmail.com>님이 작성:
>
> Hi,
> >
> > If I run one query on Tajo shell, then exit, everything is fine.
> >
> > but If I run more queries one by one on Tajo shell, then display
> > information has some strange: pay attention red font bellow:
> >
> > default> select count(*) from (select dvc_id from tds_did_user_targ_day
> > where dt='20150228' and platform='pc' group by dvc_id) t;
> > Progress: 0%, response time: 0.577 sec
> > Progress: 0%, response time: 0.578 sec
> > Progress: 0%, response time: 0.979 sec
> > Progress: 0%, response time: 1.78 sec
> > Progress: 20%, response time: 2.781 sec
> > Progress: 27%, response time: 3.782 sec
> > Progress: 30%, response time: 4.784 sec
> > Progress: 33%, response time: 5.785 sec
> > Progress: 33%, response time: 6.787 sec
> > Progress: 33%, response time: 7.788 sec
> > Progress: 45%, response time: 8.789 sec
> > Progress: 51%, response time: 9.791 sec
> > Progress: 57%, response time: 10.792 sec
> > Progress: 59%, response time: 11.793 sec
> > Progress: 60%, response time: 12.794 sec
> > Progress: 65%, response time: 13.795 sec
> > Progress: 100%, response time: 14.148 sec
> > ?count
> > -------------------------------
> > 35620159
> > (1 rows, 14.148 sec, 9 B selected)
> > default>
> > default>
> > default>
> > default> select count(*) from (select dvc_id from tds_did_user_targ_day
> > where dt='20150228' and platform='tv' group by dvc_id) t;
> > Progress: 0%, response time: 0.564 sec
> > Progress: 0%, response time: 0.565 sec
> > Progress: 0%, response time: 0.966 sec
> > Progress: 33%, response time: 1.767 sec
> > Progress: 55%, response time: 2.769 sec
> > Progress: 55%, response time: 3.77 sec
> > Progress: 100%, response time: 4.01 sec
> > ?count
> > -------------------------------
> > 1338320
> > (1 rows, 4.01 sec, 8 B selected)
> > default> select count(*) from (select dvc_id from tds_did_user_targ_day
> > where dt='20150228' and platform='mc' group by dvc_id) t;
> > Progress: 0%, response time: 0.3 sec
> > Progress: 0%, response time: 0.301 sec
> > Progress: 0%, response time: 0.703 sec
> > Progress: 0%, response time: 1.504 sec
> > Progress: 33%, response time: 2.506 sec
> > Progress: 33%, response time: 3.507 sec
> > Progress: 33%, response time: 4.508 sec
> > Progress: 50%, response time: 5.51 sec
> > Progress: 50%, response time: 6.511 sec
> > Progress: 60%, response time: 7.512 sec
> > Progress: 61%, response time: 8.513 sec
> > Progress: 60%, response time: 9.514 sec
> > Progress: 100%, response time: 10.165 sec
> > ?count
> > -------------------------------
> > 21463580
> > (1 rows, 10.165 sec, 9 B selected)
> > default> select count(*) from (select dvc_id from tds_did_user_targ_day
> > where dt='20150228' and platform='cloud' group by dvc_id) t;
> > Progress: 0%, response time: 0.3 sec
> > Progress: 0%, response time: 0.302 sec
> > Progress: 0%, response time: 0.703 sec
> > Progress: 0%, response time: 1.505 sec
> > Progress: 33%, response time: 2.506 sec
> > Progress: 33%, response time: 3.507 sec
> > Progress: 51%, response time: 4.508 sec
> > Progress: 51%, response time: 5.509 sec
> > Progress: 58%, response time: 6.51 sec
> > Progress: 58%, response time: 7.511 sec
> > Progress: 50%, response time: 8.512 sec
> > Progress: 61%, response time: 9.514 sec
> > Progress: 100%, response time: 9.761 sec
> > ?count
> > -------------------------------
> > 13785100
> > (1 rows, 9.761 sec, 9 B selected)
> >
> >
> > Tajo-0.9.0 with Hadoop-2.6,  I built Tajo from source. make a little
> change
> > to compatable with Hadoop-2.6.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message