hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johan Oskarson (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-457) Unable to create file in dfs in code run on machine not in the cluster.
Date Fri, 18 Aug 2006 10:12:15 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-457?page=comments#action_12428965 ] 
Johan Oskarson commented on HADOOP-457:

This must've been caused by some unrelated problem.
A clean install doesn't produce this problem.

Sorry for any inconvenience caused by this bug report.

> Unable to create file in dfs in code run on machine not in the cluster.
> -----------------------------------------------------------------------
>                 Key: HADOOP-457
>                 URL: http://issues.apache.org/jira/browse/HADOOP-457
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.5.0
>            Reporter: Johan Oskarson
> I've got a tiny hadoop cluster and one machine that's not in the cluster that rsync the
latest version off the namenode/jobtracker machine. The machine that's not in the cluster
is then responsible for starting a few jobs here and there.
> However, the latest trunk is unable to create files in the dfs from my code.
> I'm using a simple new OutputStreamWriter(fs.create(file))); and the file creation looks
like it's going ok but then this gets thrown:
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: failed to create file /user/hadoop/submissions/1150000000/1152000000/1152440000/.1155824015.negsub.crc
on client "servernotincluster" because target-length is 0, below MIN_REPLICATION (1)
>         at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:410)
>         at org.apache.hadoop.dfs.NameNode.create(NameNode.java:202)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:332)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:468)
>         at org.apache.hadoop.ipc.Client$Connection.run(Client.java:159)
> If I add that machine to the conf/slaves it works fine. Note that it's trying to create
that file on the server that's not in the cluster.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message