Return-Path: X-Original-To: apmail-apex-dev-archive@minotaur.apache.org Delivered-To: apmail-apex-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 237AA18914 for ; Thu, 7 Jan 2016 04:57:06 +0000 (UTC) Received: (qmail 26868 invoked by uid 500); 7 Jan 2016 04:57:05 -0000 Delivered-To: apmail-apex-dev-archive@apex.apache.org Received: (qmail 26802 invoked by uid 500); 7 Jan 2016 04:57:05 -0000 Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.incubator.apache.org Delivered-To: mailing list dev@apex.incubator.apache.org Received: (qmail 26789 invoked by uid 99); 7 Jan 2016 04:57:05 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Jan 2016 04:57:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id ADECFC09C2 for ; Thu, 7 Jan 2016 04:57:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.98 X-Spam-Level: ** X-Spam-Status: No, score=2.98 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=datatorrent-com.20150623.gappssmtp.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id MnZDdYST0NH8 for ; Thu, 7 Jan 2016 04:56:58 +0000 (UTC) Received: from mail-yk0-f173.google.com (mail-yk0-f173.google.com [209.85.160.173]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id BF2C3439D5 for ; Thu, 7 Jan 2016 04:56:58 +0000 (UTC) Received: by mail-yk0-f173.google.com with SMTP id v14so235240324ykd.3 for ; Wed, 06 Jan 2016 20:56:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=datatorrent-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=vGmsyM6dZFTG4OU6cHDVplSfBuYlSOs9eykeLzECAvk=; b=ogkw2GglP2IZtCDvqkLM3YkFpjf3r9b+Taj1Gl43S9gB9jV8VLe+yoMVBLERPUtkuh 89fWKCZuvVGmZSG6vnX2s4btWcofFlZFXERiNmZr6ZuGctWrkX4aBfRro06wG+koOQC1 OZsQubWSK5f5EiWSnSuFEAQmpj0qGe6nsxwb4YGpO3D88q7DDCNQjwR1/eipRNV5KbVH Z9zV9ZCgTW9vMkynAaIZMXvyBAIDe5fAwr28l6ZUBrD+Ia8tVKtZXlUes6fc+0tsRdkE hYu6pFWcdANYr84ek6TElBIL2Y/ihaU9erOnu2F/YBKKk6O3seidCwlKNwEJQHAn1/k/ tIug== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=vGmsyM6dZFTG4OU6cHDVplSfBuYlSOs9eykeLzECAvk=; b=YXHtvlOJdJIVNR8zQEBK12VjeIpU5ER2aIK43rpaBXjfxahJLbHijz/QY4A9VUcOKn FAlTxz+vzhPYL8lzmMOS9ZRRgKEuxQhsHLdYRWc6b8nZcrXk+KC4rr+Of4sexp7riHkq LSQ8ueIL/yZMdDBqp2C1kpCLvrbAoaXofbZvzBcc+p7jkpTIwgvf9uKk9FEabSiPv+h3 bo2nXlR6SKooRdb5j75IDhAAtk0fm+wXn7pPmTbFRM/Pn+KesJN8GTDlM7maDh+R7tGP Vlh4Yfq0du9gj3WduDYCeVXF4OJPY3e08Ie8nrZQpiApLWScrKOJ+ZLzQs5lozBl7Q1S GkjA== X-Gm-Message-State: ALoCoQm5SiqFYHhG5yhyBRmG3M9kvFpJn2M0U55lCoqWGyzKa5AqxKhXMnKCBlpugpiBPswOgD5k0zrgIFTWgZOhgVfv5GBEg2Db8UYW2CiY+SJXu4wUQOc= MIME-Version: 1.0 X-Received: by 10.13.218.129 with SMTP id c123mr83319585ywe.4.1452142612261; Wed, 06 Jan 2016 20:56:52 -0800 (PST) Received: by 10.37.99.198 with HTTP; Wed, 6 Jan 2016 20:56:52 -0800 (PST) In-Reply-To: References: Date: Thu, 7 Jan 2016 10:26:52 +0530 Message-ID: Subject: Re: Malhar library does not build on adding additional dependency From: Shubham Pathak To: dev@apex.incubator.apache.org Content-Type: multipart/alternative; boundary=94eb2c08090c917aa20528b74c37 --94eb2c08090c917aa20528b74c37 Content-Type: text/plain; charset=UTF-8 Hi Chandni, This is enhancement to existing JSON Parser ( currently in malhar lib) to take in schema for validations ( similar to XML / CSV parsers ). Thanks, Shubham On Thu, Jan 7, 2016 at 12:35 AM, Chandni Singh wrote: > Hey Shubham, > > Can the enhancement (extension) which adds a new dependency go into > contrib? > > Thanks, > Chandni > > On Wed, Jan 6, 2016 at 12:37 AM, Shubham Pathak > wrote: > > > Chinmay, > > > > I tried to build malhar-library with the latest version of > > json-schema-validator and it builds successfully without me having to add > > dependency for jsr. > > > > However, when i try to run the test, it throws a runtime error > > [image: Inline image 1] > > > > > > > > Issue is that guava 11.0 is being considered instead of 16.01. > > > > One solution to this can be add for guava in apex common but > > that seems risky as it might lead to run time exceptions. > > > > For now I am going ahead with the approach i mentioned in my previous > > mail. > > > > > > Thomas, > > No new operator is being added. Existing operator is being enhanced and > > that requires a dependency to be added. > > > > > > Thanks, > > Shubham > > > > On Tue, Jan 5, 2016 at 11:25 PM, Thomas Weise > > wrote: > > > >> There was a discussion a while ago on why we don't want to add > >> dependencies > >> to malhar-library unless they are broadly applicable to many operators. > >> Please review that discussion. > >> > >> As for adding dependencies in general, please analyze the situation > >> carefully before moving ahead.. You will want to look at licenses, > >> possible > >> conflicts with engine/Hadoop, transitive dependencies, functional > overlap > >> with existing dependencies etc. Also state why the dependency is needed. > >> > >> Thomas > >> > >> > >> On Tue, Jan 5, 2016 at 8:27 AM, Chinmay Kolhatkar < > >> chinmay@datatorrent.com> > >> wrote: > >> > >> > Hey Shubham, > >> > > >> > FileSplitterInput was already present and devel-3 compiles fine > without > >> > jsr305 dependency (for Nullable). > >> > It seems that adding json related dependency is affecting somewhere > >> else. > >> > > >> > Can you please check if all the unit tests are passing after adding > >> > findbug's jsr305 dependency? > >> > > >> > Also, There seems to be quite some versions of json-schema-validator > >> after > >> > 2.0.1, would it make sense to use latest version as dependency? > >> > > >> > Thanks, > >> > Chinmay. > >> > > >> > > >> > > >> > ~ Chinmay. > >> > > >> > On Tue, Jan 5, 2016 at 5:29 PM, Shubham Pathak < > shubham@datatorrent.com > >> > > >> > wrote: > >> > > >> > > Fixed by adding dependency of jsr . Now the pom looks like this > >> > > > >> > > > >> > > com.github.fge > >> > > json-schema-validator > >> > > 2.0.1 > >> > > > >> > > > >> > > com.google.code.findbugs > >> > > jsr305 > >> > > 1.3.9 > >> > > true > >> > > > >> > > > >> > > Thanks, > >> > > Shubham > >> > > > >> > > > >> > > On Tue, Jan 5, 2016 at 2:35 PM, Shubham Pathak < > >> shubham@datatorrent.com> > >> > > wrote: > >> > > > >> > > > Hi, > >> > > > > >> > > > I am working on an operator that needs following dependency to be > >> added > >> > > in > >> > > > Malhar lib > >> > > > > >> > > > com.github.fge > >> > > > json-schema-validator > >> > > > 2.0.1 > >> > > > > >> > > > > >> > > > But when i add this, and try to build malhar library, i get > >> following > >> > > error > >> > > > > >> > > > >> > > >> > /code/projects/Apache/incubator-apex-malhar/library/src/main/java/com/datatorrent/lib/io/fs/FileSplitterInput.java:[36,24] > >> > > > cannot find symbol > >> > > > [ERROR] symbol: class Nullable > >> > > > [ERROR] location: package javax.annotation > >> > > > > >> > > > On further investigation i noticed, when i add the above > dependency, > >> > > > jsr305 jar doesn't show up in dependency hierarchy. > >> > > > > >> > > > If i remove the above dependency, jsr305 shows up. > >> > > > > >> > > > Can anyone please help ? > >> > > > > >> > > > Thanks, > >> > > > Shubham > >> > > > > >> > > > >> > > >> > > > > > --94eb2c08090c917aa20528b74c37--