flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Metzger <rmetz...@apache.org>
Subject Re: org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl
Date Fri, 24 Mar 2017 09:34:39 GMT
Hi,

I don't think that his error is actually an issue:
https://issues.apache.org/jira/browse/YARN-1022
Is something not working as expected in your application?

On Fri, Mar 24, 2017 at 5:53 AM, <rimin515@sina.cn> wrote:

> hi,i read file from hdfs,but there is error when run jon on yarn clutster,
> -----------------------------------------------
> val dataSeg = env.readTextFile("hdfs:///user/hadoop/text").filter(!_.startsWith("#")).map
{ x =>
>            val values = x.split("\t")
>            (values.apply(0),values.apply(1).split(" "))
>         }
>
>         logger.info("****dataSeg****="+dataSeg.count())
>
> the error is following:
> --------------------------------------------------------------
> 2017-03-24 11:32:15,012 INFO  org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl
 - Interrupted while waiting for queue
> java.lang.InterruptedException
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052)
> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
> 	at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$CallbackHandlerThread.run(AMRMClientAsyncImpl.java:274)
> -----------------------------
> hadoop is 2.6
> flink is 1.1.0-hadoop2.6-scala-2.11
> (the org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl is in flink-shaded-hadoop2-1.1.0
)
>
>

Mime
View raw message