Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 886DD200B45 for ; Fri, 15 Jul 2016 20:33:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 86EC0160A61; Fri, 15 Jul 2016 18:33:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D05A4160A57 for ; Fri, 15 Jul 2016 20:33:09 +0200 (CEST) Received: (qmail 53920 invoked by uid 500); 15 Jul 2016 18:33:09 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 53899 invoked by uid 99); 15 Jul 2016 18:33:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Jul 2016 18:33:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 536321A1318 for ; Fri, 15 Jul 2016 18:33:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.429 X-Spam-Level: * X-Spam-Status: No, score=1.429 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id cdgrawPGOzIY for ; Fri, 15 Jul 2016 18:33:07 +0000 (UTC) Received: from mail-wm0-f48.google.com (mail-wm0-f48.google.com [74.125.82.48]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 98D775FD34 for ; Fri, 15 Jul 2016 18:33:06 +0000 (UTC) Received: by mail-wm0-f48.google.com with SMTP id f65so35696418wmi.0 for ; Fri, 15 Jul 2016 11:33:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=yoCebf0wadRGkBREAp7tR1vQYuMHCv2pj/m6tumV6ss=; b=KXLps4mMSIS1r6zsoUqheVz31pzG/4EfIt5CQ7J8nJUntvcc+vEoeNqL5SnBEtL2O0 jDewjEnTYS1luWMvN35hm7uKoSxVYAeHKXf3chkdKobSRoaXvU7Wu6T2rYeVeCoCBcrv 5mlygiaTmdUkcjf4Oe5kRfrnjk+s82Ss/ojGOu+T+AMkvb3ZAerAsST2PN08m6sl2Gp4 dBrOtxsk3LuNDhwdDmP1nTR7Wt5MTFTQJFb0wLl88M93nCizBtM6ZLWbG1tqOoHFQKtF g23ruBQ9vtV81GmPW20PjvJrGH4XgCohqZZq0bc/pxNgnWxp7RfB7UgyjOpeWkNJgNlN g3+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=yoCebf0wadRGkBREAp7tR1vQYuMHCv2pj/m6tumV6ss=; b=f4JJTvBbRQUHZZOyvd+nv5yZkZUZtBcoV0jLM/5CGvvvq7vLBIKm1kO7vwJVPw9pRL KqPt4nxWJWF2e3xEbU1N/AoZ8LS5soLR3jssWuIhg0F/HQRBrWF7qi5LkkaK7FYTYTpA kp9k+KsiRybSV9OXLn2+OHZAnnh6uDu5dJwC13PAAxVvJodBUIoruGTjd3HacWxO626G IXsS9k78LSP7s3ZphGRuYNDP6M2oW1nCUe2mVSG/reGAz1gJquFdoHwspbHliyGBFGwR 58lR+DGFHL1ZTHaXbTDTPz4V6wNSU5M3cAjdQdVcg/xaiLyj1uOupQ6vD7rcR+oo+LDY +9Mw== X-Gm-Message-State: ALyK8tLTStV7QFPsR67NLyHcLTEhkeDmaIbkecKg4Q5W5OTj/a1o661K/ppbwzFEDRjmzI6mH+c7/mdYpufS8g== X-Received: by 10.28.94.18 with SMTP id s18mr5046312wmb.44.1468607584849; Fri, 15 Jul 2016 11:33:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.194.184.230 with HTTP; Fri, 15 Jul 2016 11:32:45 -0700 (PDT) In-Reply-To: References: From: Jason Jeong Date: Fri, 15 Jul 2016 11:32:45 -0700 Message-ID: Subject: Re: IMRU Map codec configuration is not passed? To: dev@reef.apache.org Content-Type: multipart/alternative; boundary=001a11468e0868d69a0537b0d913 archived-at: Fri, 15 Jul 2016 18:33:10 -0000 --001a11468e0868d69a0537b0d913 Content-Type: text/plain; charset=UTF-8 The IMRUJobDefinitionBuilder class includes the method SetMapInputCodecConfiguration(), which is 1) public and 2) included in release 0.15. The problem is, deprecation implies that the functionality is still active, but currently IMRUJobDefinitionBuilder.SetMapInputCodecConfiguration() does nothing; as Dhruv said, this is a bug. I think the most quickest way to solve this would be to remove SetMapInputCodecConfiguration() and rename SetUpdateFunctionCodecConfiguration() to SetCodecConfiguration(), but if deleting a public interface is more problematic then I guess we deprecate both SetMapInputCodecConfiguration() and SetUpdateInputCodecConfiguration(), and add a new SetCodecConfiguration() method. Jason On Thu, Jul 14, 2016 at 10:54 AM, Mariia Mykhailova wrote: > > This needs to be fixed. Markus/Julia do we need to go through > deprecation process for this? > > We need deprecation process if 1) we delete a publically accessible > interface, and 2) it's been available in release 0.15 or earlier (so it's > part of our contract). > IMRU.OnREEF.Driver.ConfigurationManager.MapInputCodecConfiguration itself > is internal, so can be deleted safely. For other functions you want to > modify, we might have to go through deprecation. > > -Mariia > > -----Original Message----- > From: Dhruv Mahajan [mailto:dhruv.mahajan@gmail.com] > Sent: Wednesday, July 13, 2016 6:41 PM > To: dev@reef.apache.org > Subject: Re: IMRU Map codec configuration is not passed? > > Jason > > i looked at the code. Here is what happened: > > During one of Pull requests, I decided to use only one codec configuration > for both map and update tasks. However, I forgot to change > IMRUJobDefinition so that instead of two functions > (SetMapInputCodecConfiguration and SetMapFunctionCodecConfiguration) we > simply have one SetCodecConfiguration. So this is sort of a bug which does > not impact the IMRU run the reason being that > UpdateFunctionCodeConfiguration is subset of MapFunctionCodecs. > > This needs to be fixed. Markus/Julia do we need to go through deprecation > process for this? > > Dhruv > > On Wed, Jul 13, 2016 at 5:32 PM, Jason Jeong > wrote: > > > Hi, > > > > Find Usages on > > `IMRU.OnREEF.Driver.ConfigurationManager.MapInputCodecConfiguration` > > gives me nothing, implying that the map input codec is not being > > passed to Map and Update Tasks. > > Is this a bug, or am I making some obvious mistake? > > > > Thanks, > > Jason > > > --001a11468e0868d69a0537b0d913--