Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6112018A42 for ; Wed, 20 Jan 2016 20:59:35 +0000 (UTC) Received: (qmail 52128 invoked by uid 500); 20 Jan 2016 20:59:30 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 52057 invoked by uid 500); 20 Jan 2016 20:59:30 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 52045 invoked by uid 99); 20 Jan 2016 20:59:29 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Jan 2016 20:59:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 77BA5C0599 for ; Wed, 20 Jan 2016 20:59:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.001 X-Spam-Level: *** X-Spam-Status: No, score=3.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id cB72mFiKLTYw for ; Wed, 20 Jan 2016 20:59:20 +0000 (UTC) Received: from mail-ig0-f179.google.com (mail-ig0-f179.google.com [209.85.213.179]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 71EAF4293A for ; Wed, 20 Jan 2016 20:59:20 +0000 (UTC) Received: by mail-ig0-f179.google.com with SMTP id ik10so109590035igb.1 for ; Wed, 20 Jan 2016 12:59:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:content-type; bh=b1EOPqnNtoNKtECpEoscktdVfyECU4E/XXmPWY4ld0E=; b=kmFbTjJrAEslXPV5lUtLYpfE52WOQ47n8ePjXJHFuDZ2uK7krWTf1o1bb7nAQMY3lE BqJm0V3f6gTb3dQyITnmpTHT92fC55RprdaD8Px+TSR2I7i7SGZZvY75c5fG27SxRr8R uipMonARWcsBA/pGuPOrjooYu+iybTZLf3X0qQM+gjSjXx3t9tWbfFHc/EvmYgmeslsv mzPDJI75XZvAe08LTu6ijviOpKFjyk35eKhFgSamJg6CLLEuQcE0KToBbsVlk+m0LXfV eTR+GoUlaZYULEvzFZf+eZAcKXWeXSewdSJ3LIOjnl1XWE2cz2Jmt7sC2U+gXDJDLWLB toEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=b1EOPqnNtoNKtECpEoscktdVfyECU4E/XXmPWY4ld0E=; b=dAMjFIzabLSV/ZGQ/Dx0YgxycRbtFllzNg60L1ZpeZhRgz0kWyDAcfncBnkyfF95D6 W6GoA15HyJoRSYnzpuw8ew5EMJllipCn9hkbGiZxK1rQXfNJcWRx24RH2eg081CyN/lE Lp7WNuxjlxm4500hogkHUjTkOU+m/nZUlkwMOARUP4f+USaGGLuCVy7QhGJe8kDvu2VN pKtXn2KAkcyRpYzqG8a7NW43idhx3h7p5y9x2HCv14JLkIBKcZyi+TgB9gO2zJgTaKvN HpqUXe2ge/T/qwEiQcYqlEPRTO+auYSYKeOd8u/uzzhiBNUVWyYR20sokKqVNLNCDLwO tvKQ== X-Gm-Message-State: AG10YOQ6KffWZs4qszC4XtIMwVwoumOgxy6PUiYn8Pl7gM/ZY3hphNUB9/w2SHw1tJOdrFVu57ReArLvwCXYKg== MIME-Version: 1.0 X-Received: by 10.50.160.1 with SMTP id xg1mr5717223igb.62.1453323554767; Wed, 20 Jan 2016 12:59:14 -0800 (PST) Sender: ewenstephan@gmail.com Received: by 10.107.159.194 with HTTP; Wed, 20 Jan 2016 12:59:14 -0800 (PST) In-Reply-To: References: Date: Wed, 20 Jan 2016 21:59:14 +0100 X-Google-Sender-Auth: cGox9oeBJOOGGRqsuG-PyZWWoJw Message-ID: Subject: Re: maven dependency problem when building stream job From: Stephan Ewen To: "dev@flink.apache.org" Content-Type: multipart/alternative; boundary=001a1134145a39cf1e0529ca427a --001a1134145a39cf1e0529ca427a Content-Type: text/plain; charset=UTF-8 Hi Martin! It looks like your project added a rule to not allow a higher netty.io version. Any specific reason that the rule was added? Would be good to understand that, because the rule stands in conflict with Flink's dependencies. Flink internally has multiple uses of netty: Akka remote, Flink network stack, ZooKeeper. It has had those dependencies for quite a while, so I guess it was not a recent change in Flink, but probably a change in the "logproc-flink" pom.xml file. Stephan On Wed, Jan 20, 2016 at 2:43 PM, Martin Neumann wrote: > Its a fork of a different project, so I didn't add it myself. I disabled it > for now and so far it works, I will try to find out why it was there in the > first place and if necessary find a workaround. > > thanks for the help > Martin > > On Wed, Jan 20, 2016 at 2:32 PM, Robert Metzger > wrote: > > > Hi Martin. > > > > can you try to exclude the netty dependency from your Flink dependencies? > > Another approach would be to disable the check, or add an exception to it > > ;) > > > > Why did you add the check in the first place? > > > > > > On Wed, Jan 20, 2016 at 2:13 PM, Martin Neumann > wrote: > > > > > Its using a maven-enforcer-plugin (see config below). The project > itself > > > does not use netty. > > > I just discovered that I still compile fine from within IntelliJ I just > > > cannot built it externally with maven (which I need to package the jar > to > > > deploy on Yarn). > > > > > > cheers Martin > > > > > > > > > maven-enforcer-plugin > > > 1.4.1 > > > > > > > > > enforce > > > > > > > > > > > > > > > true > > > > > > > > > enforce > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Wed, Jan 20, 2016 at 2:04 PM, Robert Metzger > > > wrote: > > > > > > > Hi Martin, > > > > > > > > is the logproc-flink project using the maven-enforcer-plugin to > > enforce a > > > > minimum version of netty? > > > > We recently downgraded (a minor version) of netty because of an > issue. > > > > Maybe that's the issue. > > > > > > > > Can you check the enforcer rules of your project? > > > > > > > > On Wed, Jan 20, 2016 at 1:48 PM, Martin Neumann > > > wrote: > > > > > > > > > Hi, > > > > > > > > > > I have a weird problem. Yesterday I had to clean my local maven > cache > > > > for a > > > > > different application. > > > > > Since afterwards one of my Flink streaming jobs does not compile > > > > anymore. I > > > > > didn't change any code just made maven pull all dependencies again. > > > > > > > > > > I'm totally stomped by this, please help me! > > > > > > > > > > Here is the error I get from maven: > > > > > > > > > > [WARNING] Rule 0: > > > org.apache.maven.plugins.enforcer.RequireUpperBoundDeps > > > > > failed with message: > > > > > Failed while enforcing RequireUpperBoundDeps. The error(s) are [ > > > > > Require upper bound dependencies error for > io.netty:netty:3.7.0.Final > > > > paths > > > > > to dependency are: > > > > > +-com.spotify:logproc-flink:0.0.0-SNAPSHOT > > > > > +-org.apache.flink:flink-java:0.10.1 > > > > > +-org.apache.flink:flink-shaded-hadoop2:0.10.1 > > > > > +-org.apache.zookeeper:zookeeper:3.4.6 > > > > > +-io.netty:netty:3.7.0.Final > > > > > and > > > > > +-com.spotify:logproc-flink:0.0.0-SNAPSHOT > > > > > +-org.apache.flink:flink-streaming-java:0.10.1 > > > > > +-org.apache.flink:flink-runtime:0.10.1 > > > > > +-com.typesafe.akka:akka-remote_2.10:2.3.7 > > > > > +-io.netty:netty:3.8.0.Final > > > > > ] > > > > > [ERROR] Failed to execute goal > > > > > org.apache.maven.plugins:maven-enforcer-plugin:1.4.1:enforce > > (enforce) > > > on > > > > > project logproc-flink: Some Enforcer rules have failed. Look above > > for > > > > > specific messages explaining why the rule failed. -> [Help 1] > > > > > > > > > > > > > > > --001a1134145a39cf1e0529ca427a--