hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4350) TestDistributedShell fails
Date Wed, 16 Dec 2015 02:32:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059377#comment-15059377
] 

Naganarasimha G R commented on YARN-4350:
-----------------------------------------

hi [~sjlee0], 
In my local setup at least i was able to see this and expect it to happen in other setup too,
Basically during initialization we are writing the configurations into a file in the classpath,
{code}
Configuration yarnClusterConfig = yarnCluster.getConfig();
      yarnClusterConfig.set("yarn.application.classpath", new File(url.getPath()).getParent());
      //write the document to a buffer (not directly to the file, as that
      //can cause the file being written to get read -which will then fail.
      ByteArrayOutputStream bytesOut = new ByteArrayOutputStream();
      yarnClusterConfig.writeXml(bytesOut);
      bytesOut.close();
      //write the bytes to the file in the classpath
      OutputStream os = new FileOutputStream(new File(url.getPath()));
      os.write(bytesOut.toByteArray());
      os.close();
{code}
So in the next run when this previous "yarn-site.xml" property gets loaded then it overrides
the default hence i was facing issue as v2 publisher was getting set.

New issue which is reported by jenkins seems to be different need to take a look!

> TestDistributedShell fails
> --------------------------
>
>                 Key: YARN-4350
>                 URL: https://issues.apache.org/jira/browse/YARN-4350
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>    Affects Versions: YARN-2928
>            Reporter: Sangjin Lee
>            Assignee: Naganarasimha G R
>         Attachments: YARN-4350-feature-YARN-2928.001.patch, YARN-4350-feature-YARN-2928.002.patch,
YARN-4350-feature-YARN-2928.003.patch
>
>
> Currently TestDistributedShell does not pass on the feature-YARN-2928 branch. There seem
to be 2 distinct issues.
> (1) testDSShellWithoutDomainV2* tests fail sporadically
> These test fail more often than not if tested by themselves:
> {noformat}
> testDSShellWithoutDomainV2DefaultFlow(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell)
 Time elapsed: 30.998 sec  <<< FAILURE!
> java.lang.AssertionError: Application created event should be published atleast once
expected:<1> but was:<0>
> 	at org.junit.Assert.fail(Assert.java:88)
> 	at org.junit.Assert.failNotEquals(Assert.java:743)
> 	at org.junit.Assert.assertEquals(Assert.java:118)
> 	at org.junit.Assert.assertEquals(Assert.java:555)
> 	at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.checkTimelineV2(TestDistributedShell.java:451)
> 	at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.testDSShell(TestDistributedShell.java:326)
> 	at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.testDSShellWithoutDomainV2DefaultFlow(TestDistributedShell.java:207)
> {noformat}
> They start happening after YARN-4129. I suspect this might have to do with some timing
issue.
> (2) the whole test times out
> If you run the whole TestDistributedShell test, it times out without fail. This may or
may not have to do with the port change introduced by YARN-2859 (just a hunch).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message