Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B671A200CCB for ; Thu, 20 Jul 2017 20:46:08 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B4ABE16BDC5; Thu, 20 Jul 2017 18:46:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2D61716BDC4 for ; Thu, 20 Jul 2017 20:46:08 +0200 (CEST) Received: (qmail 46294 invoked by uid 500); 20 Jul 2017 18:46:02 -0000 Mailing-List: contact dev-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list dev@drill.apache.org Received: (qmail 46190 invoked by uid 99); 20 Jul 2017 18:46:02 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jul 2017 18:46:02 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id EFB5BDFF63; Thu, 20 Jul 2017 18:46:01 +0000 (UTC) From: vdiravka To: dev@drill.apache.org Reply-To: dev@drill.apache.org References: In-Reply-To: Subject: [GitHub] drill issue #877: DRILL-5660: Drill 1.10 queries fail due to Parquet Metadat... Content-Type: text/plain Message-Id: <20170720184601.EFB5BDFF63@git1-us-west.apache.org> Date: Thu, 20 Jul 2017 18:46:01 +0000 (UTC) archived-at: Thu, 20 Jul 2017 18:46:08 -0000 Github user vdiravka commented on the issue: https://github.com/apache/drill/pull/877 @paul-rogers could you please review additional commit. The main changes: 1. All IOExceptions are ignored while deserializing metadata cache files (JsonMappingException, JsonParseException...) with appropriate logging. To avoid of reading such corrupted or unsupported file again that status is stored in metadata context. 2. Creating the metadata context while expanding Selection from Metadata Cache (if it is `null`) allows to always detect the status of partition punning. 3. Two new test cases are added: `testCorruptedMetadataFile()` and `testFutureUnsupportedMetadataVersion()`. 4. Test data created in `@BeforeClass` in `TestParquetMetadataCache` will be removed after executing all tests. 5. For `testMetadataCacheAbsolutePaths()` and `testSpacesInMetadataCachePath()` tests `testPlanMatchingPatterns()` is added. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---