Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id CCE8D200B0F for ; Fri, 17 Jun 2016 10:57:02 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id CAE94160A61; Fri, 17 Jun 2016 08:57:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C77AA160A50 for ; Fri, 17 Jun 2016 10:57:01 +0200 (CEST) Received: (qmail 57757 invoked by uid 500); 17 Jun 2016 08:57:00 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 57747 invoked by uid 99); 17 Jun 2016 08:57:00 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Jun 2016 08:57:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 291921A092E for ; Fri, 17 Jun 2016 08:57:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.179 X-Spam-Level: ** X-Spam-Status: No, score=2.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id MM-UrEmqzQzh for ; Fri, 17 Jun 2016 08:56:58 +0000 (UTC) Received: from mail-wm0-f42.google.com (mail-wm0-f42.google.com [74.125.82.42]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 1C3E35F1F7 for ; Fri, 17 Jun 2016 08:56:58 +0000 (UTC) Received: by mail-wm0-f42.google.com with SMTP id f126so80229981wma.1 for ; Fri, 17 Jun 2016 01:56:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=SUel1Xz5yNMS9gXibH5Jbq8vphPsyPBWmWImwhiW0xg=; b=IMr23CDBVUVyKUuEfTMQ4Q3QVDPPx/7exunXUFjSnEYrlo3hwah4kzZLhfoC/Pb/UI J8WsTOhMgQR89fhKCs8z3O9/1b2V0jKP7BXIrc1oJwIHmSaoLI43tcVCgdif+3/VYvEc HRYYJuY1x8DPuBFDtQwfYqg9u+2TvwWnmGbaZC5t+0oONW4+oBJFZ0CTkhSbGkX8WgpR Xz2xgsjMOIxBNLNwM2j/oucAPUOtyv+g1QoZ0OMwkZOEnIcIsmAkbbV9usfTFrjvOhiZ m1WwXwdE9ZPEGEwZn9eKsTMghmZeRBvY1BiuJVACIuWOSx9SUQGmV4NQ21DP4cpLwYss 8qLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=SUel1Xz5yNMS9gXibH5Jbq8vphPsyPBWmWImwhiW0xg=; b=F+xk5+hnMLMBplHoqONJDI7gvT2EmU3y9DCTF2qEtvJHQ+4F25zGf7FXvsIDeA9tGu 4enJt3TravEh/H24KTOPdLM5ra1UzPM3RiRC98mppdTESsEhs7P9/wvKh+2cwYbGSyPN WvfaOfjt0gxcAEhYmiReqvMvvtYUS6JYJ4iGGB1gQwTKkaKy4Ypw26IsEhhhsaiJmrn/ 8o5b5DRR5RWSnGQ5A2WaKGi0Ov2Q31Ttl0jRIC1M+JlrcbAs7ePWfGIXWILfyvUz6kVN qkjUqT5QwTdKxsdTRgLsqQDsWD+4B97inYXu8sfU+m7SKvek5DNUzmDJgJ6OFGr1SGI7 lQCg== X-Gm-Message-State: ALyK8tKpnwX/xV+JqWJAq3T4taKdOWooNUH9SkUv5WE6BpZKOpblcIGi9Jyd6iyRpB2n0PRt0TK2vwAQ/8fCMg== X-Received: by 10.28.229.147 with SMTP id c141mr20629268wmh.5.1466153811934; Fri, 17 Jun 2016 01:56:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.70.195 with HTTP; Fri, 17 Jun 2016 01:56:22 -0700 (PDT) In-Reply-To: References: From: Fabian Hueske Date: Fri, 17 Jun 2016 10:56:22 +0200 Message-ID: Subject: Re: Kinesis connector classpath issue when running Flink 1.1-SNAPSHOT on YARN To: user@flink.apache.org Content-Type: multipart/alternative; boundary=001a114732e42582cd05357589b5 archived-at: Fri, 17 Jun 2016 08:57:03 -0000 --001a114732e42582cd05357589b5 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Josh, I assume that you build the SNAPSHOT version yourself. I had similar version conflicts for Apache HttpCore with Flink SNAPSHOT versions on EMR. The problem is cause by a changed behavior in Maven 3.3 and following versions. Due to these changes, the dependency shading is not working correctly. That's why we use Maven 3.2 to build the Flink release artifacts. Can you check whether you used Maven 3.3 and try to downgrade to 3.2 if that was the case? Cheers, Fabian 2016-06-17 8:12 GMT+02:00 Tai Gordon : > Hi Josh, > > I=E2=80=99m looking into the problem. Seems like the connector is somehow= using > older versions of httpclient. > Can you print the loaded class path at runtime, and check the path & > version of the loaded httpclient / httpcore dependency? > i.e. `classOf[HttpConnectionParams].getResource(" > HttpConnectionParams.class").toString` > > Also, on which commit was your kinesis connector built? > > Regards, > Gordon > > > On June 17, 2016 at 1:08:37 AM, Josh (jofo90@gmail.com) wrote: > > Hey, > > I've been running the Kinesis connector successfully now for a couple of > weeks, on a Flink cluster running Flink 1.0.3 on EMR 2.7.1/YARN. > > Today I've been trying to get it working on a cluster running the current > Flink master (1.1-SNAPSHOT) but am running into a classpath issue when > starting the job. This only happens when running on EMR/YARN (it's fine > when running 1.1-SNAPSHOT locally, and when running 1.0.3 on EMR) > > ---- > The program finished with the following exception: > > java.lang.NoSuchMethodError: > org.apache.http.params.HttpConnectionParams.setSoKeepalive(Lorg/apache/ht= tp/params/HttpParams;Z)V > at > com.amazonaws.http.HttpClientFactory.createHttpClient(HttpClientFactory.j= ava:96) > at com.amazonaws.http.AmazonHttpClient.(AmazonHttpClient.java:187) > at > com.amazonaws.AmazonWebServiceClient.(AmazonWebServiceClient.java:1= 36) > at > com.amazonaws.AmazonWebServiceClient.(AmazonWebServiceClient.java:1= 20) > at > com.amazonaws.services.kinesis.AmazonKinesisClient.(AmazonKinesisCl= ient.java:157) > at > com.amazonaws.services.kinesis.AmazonKinesisClient.(AmazonKinesisCl= ient.java:137) > at > org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.(K= inesisProxy.java:76) > at > org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.= (FlinkKinesisConsumer.java:166) > at > org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.= (FlinkKinesisConsumer.java:140) > at > org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.= (FlinkKinesisConsumer.java:123) > --- > > Any ideas what's going on? > > The job I'm deploying has httpclient 4.3.6 and httpcore 4.3.3 which I > believe are the libraries with the HttpConnectionParams class. > > Thanks, > Josh > > --001a114732e42582cd05357589b5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Josh,

I assume that you build th= e SNAPSHOT version yourself. I had similar version conflicts for Apache Htt= pCore with Flink SNAPSHOT versions on EMR.
The problem is ca= use by a changed behavior in Maven 3.3 and following versions.
Due to these changes, the dependency shading is not working correctly. Th= at's why we use Maven 3.2 to build the Flink release artifacts.
Can you check whether you used Maven 3.3 and try to downgrade t= o 3.2 if that was the case?

Cheers, Fabian

2016-06-17 8:12 = GMT+02:00 Tai Gordon <tzulitai@gmail.com>:
Hi Josh,

I=E2=80=99m looking into the problem. Seems like= the connector is somehow using older versions of httpclient.
Can you print the loaded class path at runtime, an= d check the path & version of the loaded httpclient / httpcore dependen= cy?
i.e. `c= lassOf[Ht= tpConnectionParams].getResource("HttpConnectionParams.class&q= uot;).toString`

Also, o= n which commit was your kinesis connector built?

Regards,
Gordon


On June 17, 2016 at 1:08:37 AM, Josh (jofo90@gmail.com) wrote:

Hey,

I've been running the Kinesis connector successfully now for a couple of weeks, on a Flink cluster running Flink 1.0.3 on EMR 2.7.1/YARN.

Today I've been trying to get it working on a cluster running the current Flink master (1.1-SNAPSHOT) but am running into a classpath issue when starting the job. This only happens when running on EMR/YARN (it's fine when running 1.1-SNAPSHOT locally, and when running 1.0.3 on EMR)

----
=C2=A0The program finished with the following exception:

java.lang.NoSuchMethodError: org.apache.http.params.HttpConnectionParams.setSoKeepalive(Lorg/apache/http= /params/HttpParams;Z)V
at com.amazonaws.http.HttpClientFactory.createHttpClient(HttpClientFactory.jav= a:96)
at com.amazonaws.http.AmazonHttpClient.<init>(AmazonHttpClient.java:187)=
at com.amazonaws.AmazonWebServiceClient.<init>(AmazonWebServiceClient.ja= va:136)
at com.amazonaws.AmazonWebServiceClient.<init>(AmazonWebServiceClient.ja= va:120)
at com.amazonaws.services.kinesis.AmazonKinesisClient.<init>(AmazonKines= isClient.java:157)
at com.amazonaws.services.kinesis.AmazonKinesisClient.<init>(AmazonKines= isClient.java:137)
at org.apache.flink.streaming.connectors.kinesis.proxy.KinesisProxy.<init&g= t;(KinesisProxy.java:76)
at org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.<init= >(FlinkKinesisConsumer.java:166)
at org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.<init= >(FlinkKinesisConsumer.java:140)
at org.apache.flink.streaming.connectors.kinesis.FlinkKinesisConsumer.<init= >(FlinkKinesisConsumer.java:123)
---

Any ideas what's going on?=C2=A0

The job I'm deploying has httpclient 4.3.6 and httpcore 4.3.3 which I believe are the libraries with the HttpConnectionParams class.

Thanks,
Josh

--001a114732e42582cd05357589b5--