Return-Path: X-Original-To: apmail-impala-dev-archive@minotaur.apache.org Delivered-To: apmail-impala-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 375F018B5B for ; Tue, 1 Mar 2016 02:13:10 +0000 (UTC) Received: (qmail 13865 invoked by uid 500); 1 Mar 2016 02:13:10 -0000 Delivered-To: apmail-impala-dev-archive@impala.apache.org Received: (qmail 13823 invoked by uid 500); 1 Mar 2016 02:13:10 -0000 Mailing-List: contact dev-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@impala.incubator.apache.org Delivered-To: mailing list dev@impala.incubator.apache.org Received: (qmail 13812 invoked by uid 99); 1 Mar 2016 02:13:09 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Mar 2016 02:13:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 5F0F9C1E3B for ; Tue, 1 Mar 2016 02:13:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.362 X-Spam-Level: X-Spam-Status: No, score=0.362 tagged_above=-999 required=6.31 tests=[RDNS_DYNAMIC=0.363, SPF_PASS=-0.001] autolearn=disabled Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 8OhHVlnWQxcw for ; Tue, 1 Mar 2016 02:13:08 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id DBFF85FB0D for ; Tue, 1 Mar 2016 02:13:07 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id u212D6cN027950; Tue, 1 Mar 2016 02:13:06 GMT Message-Id: <201603010213.u212D6cN027950@ip-10-146-233-104.ec2.internal> Date: Tue, 1 Mar 2016 02:13:06 +0000 From: "Bharath Vissapragada (Code Review)" To: Skye Wanderman-Milne , impala-cr@cloudera.com, dev@impala.incubator.apache.org CC: Juan Yu Reply-To: bharathv@cloudera.com X-Gerrit-MessageType: merged Subject: =?UTF-8?Q?[Impala-CR](cdh5-2.2.0=5F5.4.x)_IMPALA-1702:_Dump_fragment's_thrift_descriptor_when_a_table's_partition_info_is_corrupt=0A?= X-Gerrit-Change-Id: Ibb2ff05810cfd5f7aa3e210555d9d69361e8272a X-Gerrit-ChangeURL: X-Gerrit-Commit: 8c64ab12b3373512922bbb850336fcf0a81b91a5 In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.10-rc0 Bharath Vissapragada has submitted this change and it was merged. Change subject: IMPALA-1702: Dump fragment's thrift descriptor when a table's partition info is corrupt ...................................................................... IMPALA-1702: Dump fragment's thrift descriptor when a table's partition info is corrupt This patch stores the fragment's TExecPlanFragmentParams, which is the top-level thrift struct for the fragment, in the runtime state. We store the fragment params so we can dump everything sent from the FE to the BE when we detect a problem. This patch does so when a call to HdfsTable::GetPartition() returns NULL, which we never expect to happen. This will give us more information in the case of crashes caused by IMPALA-1702 or similar bugs that cause bad partition IDs to be sent to the BE. Change-Id: Ibb2ff05810cfd5f7aa3e210555d9d69361e8272a Reviewed-on: http://gerrit.cloudera.org:8080/456 Reviewed-by: Juan Yu Tested-by: Internal Jenkins (cherry picked from commit 8e92dd70e7af61934f08e0cafeeb1d62779124b4) (cherry picked from commit 1fc8fc061f74eca98ff992c8c6c5439737eb8a41) Reviewed-on: http://gerrit.cloudera.org:8080/2349 Reviewed-by: Bharath Vissapragada Tested-by: Bharath Vissapragada --- M be/src/exec/hdfs-scan-node.cc M be/src/exprs/expr-test.cc M be/src/runtime/buffered-block-mgr-test.cc M be/src/runtime/buffered-tuple-stream-test.cc M be/src/runtime/coordinator.cc M be/src/runtime/data-stream-test.cc M be/src/runtime/descriptors.h M be/src/runtime/plan-fragment-executor.cc M be/src/runtime/runtime-state.cc M be/src/runtime/runtime-state.h M be/src/util/debug-util.h 11 files changed, 61 insertions(+), 39 deletions(-) Approvals: Bharath Vissapragada: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/2349 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ibb2ff05810cfd5f7aa3e210555d9d69361e8272a Gerrit-PatchSet: 4 Gerrit-Project: Impala Gerrit-Branch: cdh5-2.2.0_5.4.x Gerrit-Owner: Bharath Vissapragada Gerrit-Reviewer: Bharath Vissapragada Gerrit-Reviewer: Internal Jenkins Gerrit-Reviewer: Juan Yu Gerrit-Reviewer: Skye Wanderman-Milne