hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nathan Grice <ngr...@gmail.com>
Subject using 'fs -put' from datanode: all data written to that node's hdfs and not distributed
Date Mon, 12 Jul 2010 20:21:56 GMT
We are trying to load data into hdfs from one of the slaves and when the put
command is run from a slave(datanode) all of the blocks are written to the
datanode's hdfs, and not distributed to all of the nodes in the cluster. It
does not seem to matter what destination format we use ( /filename vs
hdfs://master:9000/filename) it always behaves the same.
Conversely, running the same command from the namenode distributes the files
across the datanodes.

Is there something I am missing?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message