From issues-return-201827-archive-asf-public=cust-asf.ponee.io@spark.apache.org Wed Sep 12 23:14:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 36E90180630 for ; Wed, 12 Sep 2018 23:14:05 +0200 (CEST) Received: (qmail 43646 invoked by uid 500); 12 Sep 2018 21:14:04 -0000 Mailing-List: contact issues-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@spark.apache.org Received: (qmail 43637 invoked by uid 99); 12 Sep 2018 21:14:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Sep 2018 21:14:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id E7134C1358 for ; Wed, 12 Sep 2018 21:14:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -110.301 X-Spam-Level: X-Spam-Status: No, score=-110.301 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 3fd0ZeiCEuHH for ; Wed, 12 Sep 2018 21:14:03 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id B16065F3AD for ; Wed, 12 Sep 2018 21:14:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 0B8E7E0047 for ; Wed, 12 Sep 2018 21:14:02 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id C507F26EDC for ; Wed, 12 Sep 2018 21:14:01 +0000 (UTC) Date: Wed, 12 Sep 2018 21:14:01 +0000 (UTC) From: "Dilip Biswal (JIRA)" To: issues@spark.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (SPARK-25416) ArrayPosition may return incorrect result when right expression is downcasted. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Dilip Biswal created SPARK-25416: ------------------------------------ Summary: ArrayPosition may return incorrect result when right expression is downcasted. Key: SPARK-25416 URL: https://issues.apache.org/jira/browse/SPARK-25416 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.4.0 Reporter: Dilip Biswal In ArrayPosition, we currently cast the right hand side expression to match the element type of the left hand side Array. This may result in down casting and may return wrong result or questionable result. Example : spark-sql> select array_position(array(1), 1.34); 1 spark-sql> select array_position(array(1), 'foo'); null We should safely coerce both left and right hand side expressions. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org For additional commands, e-mail: issues-help@spark.apache.org