spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <>
Subject [jira] [Commented] (SPARK-6436) io/netty missing from external shuffle service jars for yarn
Date Fri, 20 Mar 2015 17:20:38 GMT


Marcelo Vanzin commented on SPARK-6436:

Hmm, weird. I have the assembly built both against hadoop-2.5 and against CDH, with my patch
from SPARK-6070, and both contain that class. Which version of Hadoop are you compiling against?
Can you try "jar tf" on the different jars under network/yarn/target?

> io/netty missing from external shuffle service jars for yarn
> ------------------------------------------------------------
>                 Key: SPARK-6436
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: Shuffle, YARN
>    Affects Versions: 1.3.0
>            Reporter: Thomas Graves
> I was trying to use the external shuffle service on yarn but it appears that io/netty
isn't included in the network jars.  I loaded up network-common, network-yarn, and network-shuffle.
 If there is some other jar supposed to be included please let me know.
> 2015-03-20 14:25:07,142 [main] FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager:
Error starting NodeManager
> java.lang.NoClassDefFoundError: io/netty/channel/EventLoopGroup
>         at<init>(
>         at<init>(
>         at
>         at org.apache.hadoop.service.AbstractService.init(
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message