hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bangbig <lizhongliangg...@163.com>
Subject hive runs slowly
Date Fri, 21 Oct 2011 09:10:56 GMT
HI all,HIVE runs too slowly when it is doing such things(see the log below), what's the problem?
because I'm joining two large table?it runs pretty fast at first. when the job finishes 95%,
it begins to slow down.--------------------------------------------------INFO org.apache.hadoop.hive.ql.exec.JoinOperator:
4 forwarding 1044000000 rows
2011-10-21 16:55:57,427 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1045000000
rows
2011-10-21 16:55:57,545 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1046000000
rows
2011-10-21 16:55:57,686 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1047000000
rows
2011-10-21 16:55:57,806 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1048000000
rows
2011-10-21 16:55:57,926 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1049000000
rows
2011-10-21 16:55:58,045 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1050000000
rows
2011-10-21 16:55:58,164 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1051000000
rows
2011-10-21 16:55:58,284 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1052000000
rows
2011-10-21 16:55:58,405 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1053000000
rows
2011-10-21 16:55:58,525 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1054000000
rows
2011-10-21 16:55:58,644 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1055000000
rows
2011-10-21 16:55:58,764 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1056000000
rows
2011-10-21 16:55:58,883 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1057000000
rows
2011-10-21 16:55:59,003 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1058000000
rows
2011-10-21 16:55:59,122 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1059000000
rows
2011-10-21 16:55:59,242 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1060000000
rows
2011-10-21 16:55:59,361 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1061000000
rows
2011-10-21 16:55:59,482 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1062000000
rows
2011-10-21 16:55:59,601 INFO org.apache.hadoop.hive.ql.exec.JoinOperator: 4 forwarding 1063000000
rows
Mime
View raw message