Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1FC98200BC5 for ; Tue, 8 Nov 2016 02:41:41 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 1E730160AF9; Tue, 8 Nov 2016 01:41:41 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6D15E160AEC for ; Tue, 8 Nov 2016 02:41:40 +0100 (CET) Received: (qmail 58407 invoked by uid 500); 8 Nov 2016 01:41:39 -0000 Mailing-List: contact reviews-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@impala.incubator.apache.org Received: (qmail 58396 invoked by uid 99); 8 Nov 2016 01:41:39 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Nov 2016 01:41:39 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 9D0C41A045E for ; Tue, 8 Nov 2016 01:41:38 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.363 X-Spam-Level: X-Spam-Status: No, score=0.363 tagged_above=-999 required=6.31 tests=[RDNS_DYNAMIC=0.363, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 0L58E0EKHbDN for ; Tue, 8 Nov 2016 01:41:37 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 5787F5F19B for ; Tue, 8 Nov 2016 01:41:37 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id uA81fa4M001169; Tue, 8 Nov 2016 01:41:36 GMT Message-Id: <201611080141.uA81fa4M001169@ip-10-146-233-104.ec2.internal> Date: Tue, 8 Nov 2016 01:41:36 +0000 From: "Tim Armstrong (Code Review)" To: impala-cr@cloudera.com, reviews@impala.incubator.apache.org CC: Dan Hecht , Lars Volker Reply-To: tarmstrong@cloudera.com X-Gerrit-MessageType: comment Subject: =?UTF-8?Q?=5BImpala-ASF-CR=5D_IMPALA-3202=3A_refactor_scratch_file_management_into_TmpFileMgr=0A?= X-Gerrit-Change-Id: I0c56c195f3f28d520034f8c384494e566635fc62 X-Gerrit-ChangeURL: X-Gerrit-Commit: 11c07b3fcfcde57c6f5676d726f2f99b2be27ddf In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.12.2 archived-at: Tue, 08 Nov 2016 01:41:41 -0000 Tim Armstrong has posted comments on this change. Change subject: IMPALA-3202: refactor scratch file management into TmpFileMgr ...................................................................... Patch Set 4: (3 comments) http://gerrit.cloudera.org:8080/#/c/4898/4/be/src/runtime/tmp-file-mgr.cc File be/src/runtime/tmp-file-mgr.cc: Line 292: " or see log for previous errors that prevented use of provided directories"); > does the log contain the errors, or do we need to log the error status at l The errors were logged via ReportIoError(). It makes more sense to accumulate the errors though and merge them together like we do below. Line 336: } else if (status.code() == TErrorCode::SCRATCH_LIMIT_EXCEEDED) { > seems like dead code now that the check is handled at the file group level, Yes, good we can simplify this. http://gerrit.cloudera.org:8080/#/c/4898/4/be/src/runtime/tmp-file-mgr.h File be/src/runtime/tmp-file-mgr.h: PS4, Line 72: allocation would exceed the allocation limit of its associated FileGrou > this check doesn't seem to be done by this function anymore. Done. Thought I removed this but memory must be faulty. -- To view, visit http://gerrit.cloudera.org:8080/4898 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0c56c195f3f28d520034f8c384494e566635fc62 Gerrit-PatchSet: 4 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong Gerrit-Reviewer: Dan Hecht Gerrit-Reviewer: Lars Volker Gerrit-Reviewer: Tim Armstrong Gerrit-HasComments: Yes