flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: MapR libraries shading issue
Date Mon, 26 Jun 2017 12:39:14 GMT
Okay, just curious because the guy mentioned the behavior changes with
removing the MapR dependencies.

Maybe these dependencies change the trust-store or certificate-store
providers?

On Mon, Jun 26, 2017 at 2:35 PM, Chesnay Schepler <chesnay@apache.org>
wrote:

> This looks more like a certification problem as described here:
> https://github.com/square/okhttp/issues/2746
>
> I don't think that shading could have anything to do with this.
>
>
> On 26.06.2017 00:09, ani.desh1512 wrote:
>
>> I am trying to use Flink (1.3.0) with MapR(5.2.1). Accordingly, I built
>> Flink
>> for Mapr as follows with maven 3.1:
>>
>> /mvn clean install -DskipTests -Dscala.version=2.10.6 -Pvendor-repos,mapr
>> -Dhadoop.version=2.7.0-mapr-1703 -Dzookeeper.version=3.4.5-mapr-1604/
>>
>> I, then added /opt/mapr/lib/* to Flink classpath, added Datadog metrics
>> entry to config and to test the config, started flink service via:
>> /./bin/jobmanager.sh start local/.
>> In the jobmanager logs, I see the following error:
>>
>> /ERROR org.apache.flink.runtime.metrics.MetricRegistry               -
>> Could
>> not instantiate metrics reporter dghttp. Metrics might not be
>> exposed/reported.
>> java.lang.IllegalStateException: Failed contacting Datadog to validate
>> API
>> key
>>          at
>> org.apache.flink.metrics.datadog.DatadogHttpClient.validateA
>> piKey(DatadogHttpClient.java:73)
>>          at
>> org.apache.flink.metrics.datadog.DatadogHttpClient.<init>(
>> DatadogHttpClient.java:61)
>>          at
>> org.apache.flink.metrics.datadog.DatadogHttpReporter.open(
>> DatadogHttpReporter.java:104)
>>          at
>> org.apache.flink.runtime.metrics.MetricRegistry.<init>(Metri
>> cRegistry.java:129)
>>          at
>> org.apache.flink.runtime.taskexecutor.TaskManagerServices.fr
>> omConfiguration(TaskManagerServices.java:188)
>>          at
>> org.apache.flink.runtime.taskmanager.TaskManager$.startTaskM
>> anagerComponentsAndActor(TaskManager.scala:1921)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$.startJobMana
>> gerActors(JobManager.scala:2322)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$.liftedTree3$
>> 1(JobManager.scala:2053)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$.runJobManage
>> r(JobManager.scala:2052)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.
>> apply$mcV$sp(JobManager.scala:2139)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.
>> apply(JobManager.scala:2117)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$2.
>> apply(JobManager.scala:2117)
>>          at scala.util.Try$.apply(Try.scala:161)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$.retryOnBindE
>> xception(JobManager.scala:2172)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$.runJobManage
>> r(JobManager.scala:2117)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$$anon$10.
>> call(JobManager.scala:1992)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$$anon$10.
>> call(JobManager.scala:1990)
>>          at
>> org.apache.flink.runtime.security.HadoopSecurityContext$1.
>> run(HadoopSecurityContext.java:43)
>>          at java.security.AccessController.doPrivileged(Native Method)
>>          at javax.security.auth.Subject.doAs(Subject.java:422)
>>          at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGro
>> upInformation.java:1595)
>>          at
>> org.apache.flink.runtime.security.HadoopSecurityContext.runS
>> ecured(HadoopSecurityContext.java:40)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager$.main(JobMana
>> ger.scala:1990)
>>          at
>> org.apache.flink.runtime.jobmanager.JobManager.main(JobManager.scala)
>> Caused by: javax.net.ssl.SSLHandshakeException:
>> sun.security.validator.ValidatorException: PKIX path building failed:
>> sun.security.provider.certpath.SunCertPathBuilderException: unable to
>> find
>> valid certi
>> fication path to requested target
>>          at sun.security.ssl.Alerts.getSSLException(Alerts.java:192)
>>          at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1949)
>>          at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:302)
>>          at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:296)
>>          at
>> sun.security.ssl.ClientHandshaker.serverCertificate(ClientHa
>> ndshaker.java:1514)
>>          at
>> sun.security.ssl.ClientHandshaker.processMessage(ClientHands
>> haker.java:216)
>>          at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1026)
>>          at sun.security.ssl.Handshaker.process_record(Handshaker.java:
>> 961)
>>          at
>> sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1062)
>>          at
>> sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSo
>> cketImpl.java:1375)
>>          at
>> sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
>>          at
>> sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
>>          at
>> org.apache.flink.shaded.okhttp3.internal.connection.RealConn
>> ection.connectTls(RealConnection.java:268)
>>          at
>> org.apache.flink.shaded.okhttp3.internal.connection.RealConn
>> ection.establishProtocol(RealConnection.java:238)
>>          at
>> org.apache.flink.shaded.okhttp3.internal.connection.RealConn
>> ection.connect(RealConnection.java:149)
>>          at
>> org.apache.flink.shaded.okhttp3.internal.connection.StreamAl
>> location.findConnection(StreamAllocation.java:192)
>>          at
>> org.apache.flink.shaded.okhttp3.internal.connection.StreamAl
>> location.findHealthyConnection(StreamAllocation.java:121)
>>          at
>> org.apache.flink.shaded.okhttp3.internal.connection.StreamAl
>> location.newStream(StreamAllocation.java:100)/
>>
>> This error disappears when I remove the mapr libs from the
>> Flink_Classpath.
>> I encounter a similar error (SSL handshake exception, PKIX path build
>> failed) when I try to use aws-sdk(1.11.123) jar in my code and submit that
>> code to flink.
>>
>> I think the shaded libs are causing this error. Am I right in assuming
>> that?
>> Is there any workaround for this?
>>
>>
>>
>>
>>
>>
>>
>> --
>> View this message in context: http://apache-flink-user-maili
>> ng-list-archive.2336050.n4.nabble.com/MapR-libraries-shad
>> ing-issue-tp13988.html
>> Sent from the Apache Flink User Mailing List archive. mailing list
>> archive at Nabble.com.
>>
>>
>

Mime
View raw message