impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Tauber-Marshall (Code Review)" <ger...@cloudera.org>
Subject [Impala-ASF-CR] IMPALA-4135: Thrift threaded server times-out connections during high load
Date Mon, 03 Oct 2016 16:24:46 GMT
Thomas Tauber-Marshall has posted comments on this change.

Change subject: IMPALA-4135: Thrift threaded server times-out connections during high load
......................................................................


Patch Set 5:

The patch passed an exhaustive run on Jenkins:
http://sandbox.jenkins.cloudera.com/job/impala-umbrella-build-and-test/4911/

I have also now, with Mostafa's help, come up with a query that reliably reproduces the issue
on the 16 node cluster and succeeds on the 16 node with this patch deployed:

 select /* +straight_join */ count(*) from
 tpch_300_parquet.orders A join /* +shuffle */  tpch_300_parquet.orders B on A.o_orderkey
= B.o_orderkey 
 join /* +shuffle */   tpch_300_parquet.orders C on c.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders D on d.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders E on e.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders F on f.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders G on g.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders H on h.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders I on i.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders J on j.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders K on k.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders L on l.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders M on m.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders N on n.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders O on o.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders P on p.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders Q on q.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders R on r.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders S on s.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders T on t.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders U on u.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders V on v.o_orderkey = B.o_orderkey
 where a.o_orderkey < 100000;

Currently working on testing it with Kerberos on.

-- 
To view, visit http://gerrit.cloudera.org:8080/4519
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie50e728974ef31a9d49132a0b3f7cde2a4f3356d
Gerrit-PatchSet: 5
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Thomas Tauber-Marshall <tmarshall@cloudera.com>
Gerrit-Reviewer: Henry Robinson <henry@cloudera.com>
Gerrit-Reviewer: Juan Yu <jyu@cloudera.com>
Gerrit-Reviewer: Matthew Jacobs <mj@cloudera.com>
Gerrit-Reviewer: Sailesh Mukil <sailesh@cloudera.com>
Gerrit-Reviewer: Thomas Tauber-Marshall <tmarshall@cloudera.com>
Gerrit-HasComments: No

Mime
View raw message