hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-9782) Datanode daemon cannot be started on OS X
Date Sun, 28 Jul 2013 02:37:49 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arpit Agarwal updated HADOOP-9782:
----------------------------------

    Description: 
Datanode fails to start with the following exception on OS X.

{code}
java.lang.UnsupportedOperationException: stat is not supported on this platform
        at org.apache.hadoop.fs.Stat.getExecString(Stat.java:91)
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:405)
        at org.apache.hadoop.util.Shell.run(Shell.java:400)
        at org.apache.hadoop.fs.Stat.getFileStatus(Stat.java:65)
        at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:792)
        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:523)
        at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:398)
        at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:129)
        at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:146)
        at org.apache.hadoop.hdfs.server.datanode.DataNode$DataNodeDiskChecker.checkDir(DataNode.java:1782)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.getDataDirsFromURIs(DataNode.java:1829)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1807)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1726)
        at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1190)
        at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:665)
        at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:334)
        at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:316)
        at org.apache.hadoop.mapreduce.v2.TestMRJobs.setup(TestMRJobs.java:112)
{code}

It appears to be caused by {{Stat#getExecString}} not supporting OS X.

  was:
Datanode fails to start with the following exception on OS X.
{code}
java.io.IOException: Unable to stat path: file:/tmp/hadoop-user/dfs/data/
	at org.apache.hadoop.fs.Stat.parseExecResult(Stat.java:104)
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:468)
	at org.apache.hadoop.util.Shell.run(Shell.java:401)
	at org.apache.hadoop.fs.Stat.getFileStatus(Stat.java:65)
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:792)
	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:523)
	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:398)
	at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:129)
	at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:146)
	at org.apache.hadoop.hdfs.server.datanode.DataNode$DataNodeDiskChecker.checkDir(DataNode.java:1782)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.getDataDirsFromURIs(DataNode.java:1829)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1806)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1726)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1749)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1921)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1942)
2013-07-27 13:51:19,460 FATAL [main] datanode.DataNode (DataNode.java:secureMain(1925)) -
Exception in secureMain
{code}

It appears to be caused by {{Stat#getExecString}} not supporting OS X.

    
> Datanode daemon cannot be started on OS X
> -----------------------------------------
>
>                 Key: HADOOP-9782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9782
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>         Environment: OS X
>            Reporter: Arpit Agarwal
>
> Datanode fails to start with the following exception on OS X.
> {code}
> java.lang.UnsupportedOperationException: stat is not supported on this platform
>         at org.apache.hadoop.fs.Stat.getExecString(Stat.java:91)
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:405)
>         at org.apache.hadoop.util.Shell.run(Shell.java:400)
>         at org.apache.hadoop.fs.Stat.getFileStatus(Stat.java:65)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:792)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:523)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:398)
>         at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:129)
>         at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:146)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode$DataNodeDiskChecker.checkDir(DataNode.java:1782)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.getDataDirsFromURIs(DataNode.java:1829)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1807)
>         at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1726)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1190)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:665)
>         at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:334)
>         at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:316)
>         at org.apache.hadoop.mapreduce.v2.TestMRJobs.setup(TestMRJobs.java:112)
> {code}
> It appears to be caused by {{Stat#getExecString}} not supporting OS X.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message