Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A7D34200D4A for ; Tue, 28 Nov 2017 15:43:04 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id A6349160C07; Tue, 28 Nov 2017 14:43:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id EC932160C01 for ; Tue, 28 Nov 2017 15:43:03 +0100 (CET) Received: (qmail 7420 invoked by uid 500); 28 Nov 2017 14:43:03 -0000 Mailing-List: contact dev-help@pig.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@pig.apache.org Delivered-To: mailing list dev@pig.apache.org Received: (qmail 7409 invoked by uid 500); 28 Nov 2017 14:43:03 -0000 Delivered-To: apmail-hadoop-pig-dev@hadoop.apache.org Received: (qmail 7406 invoked by uid 99); 28 Nov 2017 14:43:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Nov 2017 14:43:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 4DDA6C4F5E for ; Tue, 28 Nov 2017 14:43:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.311 X-Spam-Level: X-Spam-Status: No, score=-99.311 tagged_above=-999 required=6.31 tests=[KAM_NUMSUBJECT=0.5, KB_WAM_FROM_NAME_SINGLEWORD=0.2, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Xs8iTiZ331bX for ; Tue, 28 Nov 2017 14:43:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 008645F19D for ; Tue, 28 Nov 2017 14:43:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 4DF29E0162 for ; Tue, 28 Nov 2017 14:43:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 08D40241B8 for ; Tue, 28 Nov 2017 14:43:00 +0000 (UTC) Date: Tue, 28 Nov 2017 14:43:00 +0000 (UTC) From: "Nandor Kollar (JIRA)" To: pig-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (PIG-5318) Unit test failures on Pig on Spark with Spark 2.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 28 Nov 2017 14:43:04 -0000 Nandor Kollar created PIG-5318: ---------------------------------- Summary: Unit test failures on Pig on Spark with Spark 2.2 Key: PIG-5318 URL: https://issues.apache.org/jira/browse/PIG-5318 Project: Pig Issue Type: Bug Components: spark Reporter: Nandor Kollar Assignee: Nandor Kollar There are sever failing cases when executing the unit tests with Spark 2.2: {code} org.apache.pig.test.TestAssert#testNegativeWithoutFetch org.apache.pig.test.TestAssert#testNegative org.apache.pig.test.TestEvalPipeline2#testNonStandardDataWithoutFetch org.apache.pig.test.TestScalarAliases#testScalarErrMultipleRowsInInput org.apache.pig.test.TestStore#testCleanupOnFailureMultiStore org.apache.pig.test.TestStoreInstances#testBackendStoreCommunication org.apache.pig.test.TestStoreLocal#testCleanupOnFailureMultiStore {code} All of these are related to fixes/changes in Spark. TestAssert, TestScalarAliases and TestEvalPipeline2 failures could be fixed by asserting on the message of the exception's root cause, looks like on Spark 2.2 the exception is wrapped into an additional layer. TestStore and TestStoreLocal failure are also a test related problems: looks like SPARK-7953 is fixed in Spark 2.2 The root cause of TestStoreInstances is yet to be found out. -- This message was sent by Atlassian JIRA (v6.4.14#64029)