hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vrushali C (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6414) ATSv2 tests fail due to guava version upgrade
Date Fri, 31 Mar 2017 05:44:41 GMT

    [ https://issues.apache.org/jira/browse/YARN-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950358#comment-15950358
] 

Vrushali C commented on YARN-6414:
----------------------------------

Thanks for the patch [~haibochen].

This is an example of the problem which is going to keep coming up with hbase using hadoop
and now yarn using hbase dependency. Even if we disable the dependency graph check at maven
test time, I am wondering about the hbase client modules that might be using any (older) guava
invocations and hadoop deployment brings in a later version of guava in classpath. I recently
had to patch our internal hbase due to a similar guava dependency run time conflict.  cc [~jrottinghuis]

As such, patch looks fine. I can commit it in after a day. 

> ATSv2 tests fail due to guava version upgrade
> ---------------------------------------------
>
>                 Key: YARN-6414
>                 URL: https://issues.apache.org/jira/browse/YARN-6414
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: 3.0.0-alpha3
>         Environment: Ubuntu 14.04 
> x86, ppc64le
> $ java -version
> openjdk version "1.8.0_111"
> OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
> OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode)
>            Reporter: Sonia Garudi
>            Assignee: Haibo Chen
>              Labels: ppc64le, x86_64
>         Attachments: YARN-6414.00.patch, YARN-6414.01.patch
>
>
> Test failures seen in Hadoop YARN Timeline Service HBase tests project with following
error :
> {code}
> java.lang.NoClassDefFoundError: com/google/common/io/LimitInputStream
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>         at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$LoaderDelegator.load(FSImageFormat.java:223)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:913)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:899)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImageFile(FSImage.java:722)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:660)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:279)
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:955)
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:700)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:529)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:585)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:751)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:735)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1407)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:998)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:869)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:704)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:642)
>         at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:590)
>         at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:987)
>         at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:868)
>         at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:862)
>         at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:806)
>         at org.apache.hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage.setup(TestTimelineReaderWebServicesHBaseStorage.java:88)
> {code}
> Below are the failing tests :
> {code}
> TestTimelineReaderWebServicesHBaseStorage.setup:88 » NoClassDefFound com/googl...
>   TestHBaseTimelineStorageEntities.setupBeforeClass:100 » NoClassDefFound com/go...
>   TestHBaseStorageFlowActivity.setupBeforeClass:72 » NoClassDefFound com/google/...
>   TestHBaseStorageFlowRunCompaction.setupBeforeClass:84 » NoClassDefFound com/go...
>   TestHBaseStorageFlowRun.setupBeforeClass:86 » NoClassDefFound com/google/commo...
>   TestHBaseTimelineStorageApps.setupBeforeClass:93 » NoClassDefFound com/google/...
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message