hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HADOOP-13866) Upgrade netty-all to 4.1.1.Final
Date Sat, 10 Dec 2016 22:31:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738581#comment-15738581
] 

Ted Yu edited comment on HADOOP-13866 at 12/10/16 10:31 PM:
------------------------------------------------------------

Found the following error in test output:
{code}
2016-12-10 14:27:09,104 [nioEventLoopGroup-3-1] WARN  concurrent.DefaultPromise (Slf4JLogger.java:warn(146))
- An exception was thrown by org.apache.hadoop.hdfs.server.      datanode.web.SimpleHttpProxyHandler$2.operationComplete()
java.util.NoSuchElementException: io.netty.handler.codec.http.HttpResponseEncoder
  at io.netty.channel.DefaultChannelPipeline.getContextOrDie(DefaultChannelPipeline.java:1077)
  at io.netty.channel.DefaultChannelPipeline.remove(DefaultChannelPipeline.java:429)
  at org.apache.hadoop.hdfs.server.datanode.web.SimpleHttpProxyHandler$2.operationComplete(SimpleHttpProxyHandler.java:119)
  at org.apache.hadoop.hdfs.server.datanode.web.SimpleHttpProxyHandler$2.operationComplete(SimpleHttpProxyHandler.java:115)
  at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:518)
  at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:511)
  at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:490)
  at io.netty.util.concurrent.DefaultPromise.notifyListenersWithStackOverFlowProtection(DefaultPromise.java:431)
  at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:420)
  at io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:108)
  at io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:82)
  at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:304)
  at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
  at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:580)
  at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:504)
  at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:418)
  at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:390)
  at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:742)
  at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:145)
{code}


was (Author: yuzhihong@gmail.com):
Getting a strange error locally:
{code}
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.823 sec <<< FAILURE!
- in org.apache.hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame
testDataNodeXFrameOptionsEnabled(org.apache.hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame)
 Time elapsed: 1.771 sec  <<< ERROR!
java.lang.Error: Unresolved compilation problem:
	The constructor ThreadPoolExecutor(int, int, int, TimeUnit, LinkedBlockingQueue<Object>,
ThreadFactory) is undefined

	at org.apache.hadoop.security.Groups$GroupCacheLoader.<init>(Groups.java:284)
	at org.apache.hadoop.security.Groups.<init>(Groups.java:141)
	at org.apache.hadoop.security.Groups.<init>(Groups.java:102)
	at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:450)
	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:323)
	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:290)
	at org.apache.hadoop.security.UserGroupInformation.isAuthenticationMethodEnabled(UserGroupInformation.java:378)
{code}
I use Java 8 locally and have rebuilt hadoop:
{code}
java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)
{code}

> Upgrade netty-all to 4.1.1.Final
> --------------------------------
>
>                 Key: HADOOP-13866
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13866
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>         Attachments: HADOOP-13866.v1.patch, HADOOP-13866.v2.patch, HADOOP-13866.v3.patch,
HADOOP-13866.v4.patch
>
>
> netty-all 4.1.1.Final is stable release which we should upgrade to.
> See bottom of HADOOP-12927 for related discussion.
> This issue was discovered since hbase 2.0 uses 4.1.1.Final of netty.
> When launching mapreduce job from hbase, /grid/0/hadoop/yarn/local/  usercache/hbase/appcache/application_1479850535804_0008/container_e01_1479850535804_0008_01_000005/mr-framework/hadoop/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar
(from hdfs) is ahead of 4.1.1.Final jar (from hbase) on the classpath.
> Resulting in the following exception:
> {code}
> 2016-12-01 20:17:26,678 WARN [Default-IPC-NioEventLoopGroup-1-1] io.netty.util.concurrent.DefaultPromise:
An exception was thrown by org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete()
> java.lang.NoSuchMethodError: io.netty.buffer.ByteBuf.retainedDuplicate()Lio/netty/buffer/ByteBuf;
>         at org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete(NettyRpcConnection.java:272)
>         at org.apache.hadoop.hbase.ipc.NettyRpcConnection$3.operationComplete(NettyRpcConnection.java:262)
>         at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680)
>         at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603)
>         at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563)
>         at io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:406)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message