hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-510) Writing Yarn Applications documentation should be changed to signify use of of fully qualified paths when localizing resources
Date Mon, 08 Dec 2014 19:33:14 GMT

     [ https://issues.apache.org/jira/browse/YARN-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hitesh Shah updated YARN-510:
-----------------------------
    Assignee:     (was: Hitesh Shah)

> Writing Yarn Applications documentation should be changed to signify use of of fully
qualified paths when localizing resources
> ------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-510
>                 URL: https://issues.apache.org/jira/browse/YARN-510
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: documentation
>    Affects Versions: 2.0.0-alpha
>            Reporter: Hitesh Shah
>
> Path jarPath = new Path("/Working_HDFS_DIR/"+ appId +"/"+AM_JAR);
> fs.copyFromLocalFile(new Path("/local/src/AM.jar"), jarPath); // VALIDATED jar is in
HDFS under correct PATH
> FileStatus jarStatus = fs.getFileStatus(jarPath);
> LocalResource amJarRsrc = Records.newRecord(LocalResource.class);
> amJarRsrc.setType(LocalResourceType.FILE);
> amJarRsrc.setVisibility(LocalResourceVisibility.APPLICATION);
> amJarRsrc.setResource(ConverterUtils.getYarnUrlFromPath(jarPath));
> amJarRsrc.setTimestamp(jarStatus.getModificationTime());
> amJarRsrc.setSize(jarStatus.getLen());
> localResources.put("AppMaster.jar",  amJarRsrc);
> amContainer.setLocalResources(localResources);
> Error logs (nodeManager.log)
> INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1364219323374_0016 transitioned from INITING to RUNNING
> INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Got exception parsing AppMaster.jar and value resource {, port: -1, file: "/Working_HDFS_DIR/application_1364219323374_0016/AM.jar",
}, size: 13940, timestamp: 1364230436600, type: FILE, visibility: APPLICATION, 
> 2013-03-25 17:53:57,391 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Failed to parse resource-request
> java.net.URISyntaxException: Expected scheme name at index 0: :///Working_HDFS_DIR/application_1364219323374_0016/AM.jar
> 	at java.net.URI$Parser.fail(URI.java:2810)
> 	at java.net.URI$Parser.failExpecting(URI.java:2816)
> 	at java.net.URI$Parser.parse(URI.java:3008)
> 	at java.net.URI.<init>(URI.java:735)
> 	at org.apache.hadoop.yarn.util.ConverterUtils.getPathFromYarnURL(ConverterUtils.java:70)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourceRequest.<init>(LocalResourceRequest.java:46)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl$RequestResourcesTransition.transition(ContainerImpl.java:501)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl$RequestResourcesTransition.transition(ContainerImpl.java:472)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:382)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMa



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message