hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-510) Writing Yarn Applications documentation should be changed to signify use of of fully qualified paths when localizing resources
Date Wed, 27 Mar 2013 00:13:15 GMT
Hitesh Shah created YARN-510:
--------------------------------

             Summary: Writing Yarn Applications documentation should be changed to signify
use of of fully qualified paths when localizing resources
                 Key: YARN-510
                 URL: https://issues.apache.org/jira/browse/YARN-510
             Project: Hadoop YARN
          Issue Type: Bug
          Components: documentation
    Affects Versions: 2.0.0-alpha
            Reporter: Hitesh Shah
            Assignee: Hitesh Shah


Path jarPath = new Path("/Working_HDFS_DIR/"+ appId +"/"+AM_JAR);
fs.copyFromLocalFile(new Path("/local/src/AM.jar"), jarPath); // VALIDATED jar is in HDFS
under correct PATH
FileStatus jarStatus = fs.getFileStatus(jarPath);
LocalResource amJarRsrc = Records.newRecord(LocalResource.class);
amJarRsrc.setType(LocalResourceType.FILE);
amJarRsrc.setVisibility(LocalResourceVisibility.APPLICATION);
amJarRsrc.setResource(ConverterUtils.getYarnUrlFromPath(jarPath));
amJarRsrc.setTimestamp(jarStatus.getModificationTime());
amJarRsrc.setSize(jarStatus.getLen());
localResources.put("AppMaster.jar",  amJarRsrc);
amContainer.setLocalResources(localResources);

Error logs (nodeManager.log)

INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application
application_1364219323374_0016 transitioned from INITING to RUNNING
INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Got exception
parsing AppMaster.jar and value resource {, port: -1, file: "/Working_HDFS_DIR/application_1364219323374_0016/AM.jar",
}, size: 13940, timestamp: 1364230436600, type: FILE, visibility: APPLICATION, 
2013-03-25 17:53:57,391 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container:
Failed to parse resource-request
java.net.URISyntaxException: Expected scheme name at index 0: :///Working_HDFS_DIR/application_1364219323374_0016/AM.jar
	at java.net.URI$Parser.fail(URI.java:2810)
	at java.net.URI$Parser.failExpecting(URI.java:2816)
	at java.net.URI$Parser.parse(URI.java:3008)
	at java.net.URI.<init>(URI.java:735)
	at org.apache.hadoop.yarn.util.ConverterUtils.getPathFromYarnURL(ConverterUtils.java:70)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourceRequest.<init>(LocalResourceRequest.java:46)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl$RequestResourcesTransition.transition(ContainerImpl.java:501)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl$RequestResourcesTransition.transition(ContainerImpl.java:472)
	at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:382)
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMa

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message