tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jihoon Son <ghoon...@gmail.com>
Subject Re: Tajo Console display issue
Date Thu, 05 Mar 2015 11:10:14 GMT
Do you mean the problem of that the progress sometimes falls?
Basically, it can happen due to the task failures. However, it seems that
we have another problem on progress estimation while processing queries on
partitioned tables.
I'll investigate the problem.

We will release the version 0.10, soon. I expect it will be the next
Monday.
Maybe, the problem has been fixed in the new version. Would you check again
with 0.10?

Sincerely,
Jihoon


2015년 3월 5일 (목) 오후 7:12, Azuryy Yu
azuryyyu@gmail.com>님이 작성:

Hi,
>
> If I run one query on Tajo shell, then exit, everything is fine.
>
> but If I run more queries one by one on Tajo shell, then display
> information has some strange: pay attention red font bellow:
>
> default> select count(*) from (select dvc_id from tds_did_user_targ_day
> where dt='20150228' and platform='pc' group by dvc_id) t;
> Progress: 0%, response time: 0.577 sec
> Progress: 0%, response time: 0.578 sec
> Progress: 0%, response time: 0.979 sec
> Progress: 0%, response time: 1.78 sec
> Progress: 20%, response time: 2.781 sec
> Progress: 27%, response time: 3.782 sec
> Progress: 30%, response time: 4.784 sec
> Progress: 33%, response time: 5.785 sec
> Progress: 33%, response time: 6.787 sec
> Progress: 33%, response time: 7.788 sec
> Progress: 45%, response time: 8.789 sec
> Progress: 51%, response time: 9.791 sec
> Progress: 57%, response time: 10.792 sec
> Progress: 59%, response time: 11.793 sec
> Progress: 60%, response time: 12.794 sec
> Progress: 65%, response time: 13.795 sec
> Progress: 100%, response time: 14.148 sec
> ?count
> -------------------------------
> 35620159
> (1 rows, 14.148 sec, 9 B selected)
> default>
> default>
> default>
> default> select count(*) from (select dvc_id from tds_did_user_targ_day
> where dt='20150228' and platform='tv' group by dvc_id) t;
> Progress: 0%, response time: 0.564 sec
> Progress: 0%, response time: 0.565 sec
> Progress: 0%, response time: 0.966 sec
> Progress: 33%, response time: 1.767 sec
> Progress: 55%, response time: 2.769 sec
> Progress: 55%, response time: 3.77 sec
> Progress: 100%, response time: 4.01 sec
> ?count
> -------------------------------
> 1338320
> (1 rows, 4.01 sec, 8 B selected)
> default> select count(*) from (select dvc_id from tds_did_user_targ_day
> where dt='20150228' and platform='mc' group by dvc_id) t;
> Progress: 0%, response time: 0.3 sec
> Progress: 0%, response time: 0.301 sec
> Progress: 0%, response time: 0.703 sec
> Progress: 0%, response time: 1.504 sec
> Progress: 33%, response time: 2.506 sec
> Progress: 33%, response time: 3.507 sec
> Progress: 33%, response time: 4.508 sec
> Progress: 50%, response time: 5.51 sec
> Progress: 50%, response time: 6.511 sec
> Progress: 60%, response time: 7.512 sec
> Progress: 61%, response time: 8.513 sec
> Progress: 60%, response time: 9.514 sec
> Progress: 100%, response time: 10.165 sec
> ?count
> -------------------------------
> 21463580
> (1 rows, 10.165 sec, 9 B selected)
> default> select count(*) from (select dvc_id from tds_did_user_targ_day
> where dt='20150228' and platform='cloud' group by dvc_id) t;
> Progress: 0%, response time: 0.3 sec
> Progress: 0%, response time: 0.302 sec
> Progress: 0%, response time: 0.703 sec
> Progress: 0%, response time: 1.505 sec
> Progress: 33%, response time: 2.506 sec
> Progress: 33%, response time: 3.507 sec
> Progress: 51%, response time: 4.508 sec
> Progress: 51%, response time: 5.509 sec
> Progress: 58%, response time: 6.51 sec
> Progress: 58%, response time: 7.511 sec
> Progress: 50%, response time: 8.512 sec
> Progress: 61%, response time: 9.514 sec
> Progress: 100%, response time: 9.761 sec
> ?count
> -------------------------------
> 13785100
> (1 rows, 9.761 sec, 9 B selected)
>
>
> Tajo-0.9.0 with Hadoop-2.6,  I built Tajo from source. make a little change
> to compatable with Hadoop-2.6.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message