hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7
Date Tue, 29 Jan 2019 03:01:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16754540#comment-16754540
] 

Hadoop QA commented on YARN-9247:
---------------------------------

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 12m 37s{color} | {color:blue}
Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  0s{color} |
{color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  0s{color} | {color:red}
The patch doesn't appear to include any new or modified tests. Please justify why no new tests
are needed for this patch. Also please list what manual steps were performed to verify this
patch. {color} |
|| || || || {color:brown} branch-2.7.2 Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  1m 49s{color} | {color:red}
root in branch-2.7.2 failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red}  0m 28s{color} | {color:red}
hadoop-yarn-server-nodemanager in branch-2.7.2 failed with JDK v1.8.0_191. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red}  0m  9s{color} | {color:red}
hadoop-yarn-server-nodemanager in branch-2.7.2 failed with JDK v9-internal. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 21s{color}
| {color:green} branch-2.7.2 passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 18s{color} | {color:red}
hadoop-yarn-server-nodemanager in branch-2.7.2 failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m 10s{color} | {color:red}
hadoop-yarn-server-nodemanager in branch-2.7.2 failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 10s{color} | {color:red}
hadoop-yarn-server-nodemanager in branch-2.7.2 failed with JDK v1.8.0_191. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 10s{color} | {color:red}
hadoop-yarn-server-nodemanager in branch-2.7.2 failed with JDK v9-internal. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m  9s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red}  0m  9s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_191. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red}  0m  9s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_191. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red}  0m  9s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed with JDK v9-internal. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red}  0m  9s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed with JDK v9-internal. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}  0m 14s{color}
| {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} mvnsite {color} | {color:red}  0m 10s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m  0s{color}
| {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  0m  9s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 10s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed with JDK v1.8.0_191. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 10s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed with JDK v9-internal. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}  0m 10s{color} | {color:red}
hadoop-yarn-server-nodemanager in the patch failed with JDK v9-internal. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green}  0m 26s{color}
| {color:green} The patch does not generate ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 19m 18s{color} | {color:black}
{color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:date2019-01-29 |
| JIRA Issue | YARN-9247 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12956640/YARN-9247.branch-2.7.2.001.patch
|
| Optional Tests |  dupname  asflicense  compile  javac  javadoc  mvninstall  mvnsite  unit
 shadedclient  findbugs  checkstyle  |
| uname | Linux 530aaae1ffbf 4.4.0-138-generic #164~14.04.1-Ubuntu SMP Fri Oct 5 08:56:16
UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | branch-2.7.2 / b165c4f |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 9-internal |
| Multi-JDK versions |  /usr/lib/jvm/java-8-openjdk-amd64:1.8.0_191 /usr/lib/jvm/java-9-openjdk-amd64:9-internal
|
| mvninstall | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/branch-mvninstall-root.txt
|
| compile | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/branch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_191.txt
|
| compile | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/branch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk9-internal.txt
|
| mvnsite | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
|
| findbugs | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
|
| javadoc | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/branch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_191.txt
|
| javadoc | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/branch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk9-internal.txt
|
| mvninstall | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
|
| compile | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_191.txt
|
| javac | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_191.txt
|
| compile | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk9-internal.txt
|
| javac | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-compile-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk9-internal.txt
|
| mvnsite | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
|
| findbugs | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
|
| javadoc | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk1.8.0_191.txt
|
| javadoc | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk9-internal.txt
|
| unit | https://builds.apache.org/job/PreCommit-YARN-Build/23214/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdk9-internal.txt
|
| JDK v9-internal  Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/23214/testReport/
|
| Max. process+thread count | 122 (vs. ulimit of 10000) |
| modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager
U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager |
| Console output | https://builds.apache.org/job/PreCommit-YARN-Build/23214/console |
| Powered by | Apache Yetus 0.8.0   http://yetus.apache.org |


This message was automatically generated.



> NM fails to start when downgrading from 3.x to 2.7
> --------------------------------------------------
>
>                 Key: YARN-9247
>                 URL: https://issues.apache.org/jira/browse/YARN-9247
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 2.7.2
>            Reporter: Jiandan Yang 
>            Assignee: Jiandan Yang 
>            Priority: Major
>         Attachments: YARN-9247.branch-2.7.2.001.patch
>
>
> NM will throws *java.io.IOException: Unexpected container state key* when downgrading
from 3.1.3 to 2.7.2 duo to *starttime* added by hadoop3.x is not known by old version.
> {code:java}
> 2019-01-28 12:12:05,227 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager:
Error starting NodeManager
> org.apache.hadoop.service.ServiceStateException: java.io.IOException: Unexpected container
state key: ContainerManager/containers/container_e42_1548641704310_0002_01_000001/starttime
>         at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
>         at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
>         at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:263)
>         at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:536)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:584)
> Caused by: java.io.IOException: Unexpected container state key: ContainerManager/containers/container_e42_1548641704310_0002_01_000001/starttime
>         at org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService.loadContainerState(NMLeveldbStateStoreService.java:242)
>         at org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService.loadContainersState(NMLeveldbStateStoreService.java:178)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.recover(ContainerManagerImpl.java:290)
>         at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:274)
>         at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         ... 5 more
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message