Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1A0D52009DC for ; Tue, 2 May 2017 19:05:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 1886F160BAB; Tue, 2 May 2017 17:05:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 5CF84160B9D for ; Tue, 2 May 2017 19:05:09 +0200 (CEST) Received: (qmail 69001 invoked by uid 500); 2 May 2017 17:05:08 -0000 Mailing-List: contact issues-help@systemml.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.incubator.apache.org Delivered-To: mailing list issues@systemml.incubator.apache.org Received: (qmail 68992 invoked by uid 99); 2 May 2017 17:05:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 May 2017 17:05:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 103E9CF757 for ; Tue, 2 May 2017 17:05:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id PjiK-20hA4-N for ; Tue, 2 May 2017 17:05:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 240E65F3BC for ; Tue, 2 May 2017 17:05:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 666F0E062D for ; Tue, 2 May 2017 17:05:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 20ED021D90 for ; Tue, 2 May 2017 17:05:04 +0000 (UTC) Date: Tue, 2 May 2017 17:05:04 +0000 (UTC) From: "Glenn Weidner (JIRA)" To: issues@systemml.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (SYSTEMML-1520) Corrupted sparse matrix representations MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 02 May 2017 17:05:10 -0000 [ https://issues.apache.org/jira/browse/SYSTEMML-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glenn Weidner updated SYSTEMML-1520: ------------------------------------ Fix Version/s: (was: SystemML 1.0) SystemML 0.14 > Corrupted sparse matrix representations > --------------------------------------- > > Key: SYSTEMML-1520 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1520 > Project: SystemML > Issue Type: Bug > Reporter: Matthias Boehm > Assignee: Matthias Boehm > Priority: Blocker > Fix For: SystemML 0.14 > > > Apparently, there are operations that corrupt the internal sparse matrix representations in terms of (1) unsorted column indexes, and (2) duplicated column indexes, which can lead to incorrect results, and errors due to incorrect meta data (e.g., nnz) as well as index of bounds exceptions. The most recent - fortunately, perfectly reproducible - issues showed up as follows: > {code} > Caused by: java.lang.ArrayIndexOutOfBoundsException: 41 > at org.apache.sysml.runtime.matrix.data.SparseRow.append(SparseRow.java:215) > at org.apache.sysml.runtime.matrix.data.SparseBlockMCSR.append(SparseBlockMCSR.java:253) > at org.apache.sysml.runtime.matrix.data.MatrixBlock.appendValue(MatrixBlock.java:663) > at org.apache.sysml.runtime.matrix.data.LibMatrixBincell.appendRightForSparseBinary(LibMatrixBincell.java:1256) > at org.apache.sysml.runtime.matrix.data.LibMatrixBincell.mergeForSparseBinary(LibMatrixBincell.java:1238) > at org.apache.sysml.runtime.matrix.data.LibMatrixBincell.safeBinary(LibMatrixBincell.java:269) > at org.apache.sysml.runtime.matrix.data.LibMatrixBincell.bincellOp(LibMatrixBincell.java:120) > at org.apache.sysml.runtime.matrix.data.MatrixBlock.binaryOperations(MatrixBlock.java:2840) > at org.apache.sysml.runtime.instructions.cp.MatrixMatrixArithmeticCPInstruction.processInstruction(MatrixMatrixArithmeticCPInstruction.java:51) > at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:288) > {code} > The above issues was triggered due to the following combination of column index arrays for a binary operations: > {code} > cols1: [30, 38, 33, 34, 1, 8, 13, 14, 15, 16, 7, 37, 6, 5, 23, 4, 29] > cols2: [13, 14, 15, 16, 18, 20, 21, 23, 24, 26, 28, 29, 30, 32, 33, 34, 35, 36, 37, 38, 40, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 0, 0] > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)