From dev-return-2551-archive-asf-public=cust-asf.ponee.io@systemml.apache.org Tue Jan 15 11:28:53 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 6C7BD180609 for ; Tue, 15 Jan 2019 11:28:53 +0100 (CET) Received: (qmail 35991 invoked by uid 500); 15 Jan 2019 10:28:52 -0000 Mailing-List: contact dev-help@systemml.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@systemml.apache.org Delivered-To: mailing list dev@systemml.apache.org Received: (qmail 35968 invoked by uid 99); 15 Jan 2019 10:28:51 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jan 2019 10:28:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 41285180A6D for ; Tue, 15 Jan 2019 10:28:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.047 X-Spam-Level: X-Spam-Status: No, score=0.047 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 4IgTKUpDwYHh for ; Tue, 15 Jan 2019 10:28:49 +0000 (UTC) Received: from mail-wr1-f41.google.com (mail-wr1-f41.google.com [209.85.221.41]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 5EA8C610DB for ; Tue, 15 Jan 2019 10:28:49 +0000 (UTC) Received: by mail-wr1-f41.google.com with SMTP id c14so2364811wrr.0 for ; Tue, 15 Jan 2019 02:28:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=xqoP2EBPtKDYE3Sw+yMpWSYKrWVgixVMsgeIbnXyJTE=; b=oWBDm7DPKVJiSTfSLY6/PabeEd5jU/+ZmyBLJOoqH8c0RXBhzpvtasutHZH1cusUHl r5s2EJB1n4lfs2pcjIVb7Z6m6n3pgHYXDN0XH36Pjhgodp0RHLW4YheLOoHnTXgfP8wv z1VvQFOJGXNdVu3e8AJC68dYPO4MwtWojF9bw2bvD+3XHGx85DbHp9yLMNkmxzTyuOjB yx0AtSEA0aec08Dxh/ypdsPkJHCPmLmHfXMh5fE59XdsKReDvDuDp/LqMzHJ79JnERAo stLRdTpo5OB7pU9lhnP49UbXvvy1cyH7ob2HLjclau2kx4CLRZhOVqOGPeKnNubiO+cG TZ0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=xqoP2EBPtKDYE3Sw+yMpWSYKrWVgixVMsgeIbnXyJTE=; b=aHSzOgUeSQj7vNSZcMLtyQ9gxh1SnEJtwsLqpARa7wlv8yzxiBQWybAzy3ghadwQR1 UL4oXFsV+IZuKr4p9o9RfV5cvvS3TxqeNMfiEJ78uR8bNiktsXubzlKzqA2G0ZtnoVEC d/q21qyDjw+dUoFTOv4PLZhIi0NQbExGguF1b2W8PiO2KWMQHSgyRV/rGHDhp33PRbZm 1bc2h6s11BboeB9g52XDbcWqcJ5unUwsXll7OWs2wYr7WrvSY9QIPhhE6YMQb0D+Weh0 Ji7kqRBzn6CRkvOq7UxnCt/yRm0oMXzinWGeT7OYJPWZEbjh56ivL7u2boFLbaDarbLP VBoQ== X-Gm-Message-State: AJcUukf2N0ydzW4zuZJvk0PPYvF+vj2jyl22UC43gzrunVq4MzjzdhEH 58zCt7LCD+v1EFk6a9w0Vg== X-Google-Smtp-Source: ALg8bN5p8o9HgAOX+nLmXKUmzP/IAL2Ka7U64g7/R+wHqX1yrvgpcyhCo+4djSJcyQUJ5Dfh+0kgKQ== X-Received: by 2002:a5d:6a42:: with SMTP id t2mr2703755wrw.50.1547548128688; Tue, 15 Jan 2019 02:28:48 -0800 (PST) Received: from [192.168.109.52] (autodiscover.know-center.tugraz.at. [129.27.219.242]) by smtp.gmail.com with ESMTPSA id q9sm109968982wrp.0.2019.01.15.02.28.47 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 15 Jan 2019 02:28:47 -0800 (PST) Subject: Re: Autoencoder codegen testing with R To: dev@systemml.apache.org References: Cc: janardhan@apache.org From: Matthias Boehm Message-ID: <0b7e6d8a-b44a-10a9-991f-37ac59d0682a@gmail.com> Date: Tue, 15 Jan 2019 11:28:47 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit yes, you're absolutely right - in this form, results would always differ. Even if we feed a seed to both R and DML scripts, the implementation of our rand is very different as we need to ensure that, given a seed, we generate the same data in local and distributed operations. Accordingly, we derive seeds for each 1K x 1K block from the initial seed. For testing purposes, we usually use one of the following two approaches: (1) use constant matrices or sequences (matrix/seq), or (2) generate the random data outside and read it into both scripts. Accordingly, I would recommend to create a copy of the dml script, place it inside the test directory, and modify the script accordingly. Regards, Matthias On 15/01/2019 05:40, Janardhan wrote: > Hi, > > I have replicated AutoEncoder-2layer script in R. But, can the output files > (W1, b1, ...) will match the R script. (not matching in my implementation). > > Because, we have used Rand functions without seed in dml script also R > doesn't provide any Rand(.., seed=..) function. I have just used > > *IN DML : Rand(m, n, min=-1, max=1)* > *IN R: runif(n, min=-1, max=1) %*% matrix(1, m, 1) * > > Should the results from Autoencoder-2layer.dml will match with that of R > script. > > Thanks, > Janardhan >