hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ccxixicc" <ccxix...@foxmail.com>
Subject How to create a lot files in HDFS quickly?
Date Mon, 30 May 2011 02:44:18 GMT
Hi all

I'm doing a test and need create lots of files ( 100 million ) in HDFS, I use a shell script
to do this , it's very very slow, how to create a lot files in HDFS quickly?
Thanks
Mime
View raw message