hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pedro Sá da Costa <psdc1...@gmail.com>
Subject split big files into small ones to later copy
Date Fri, 07 Jun 2013 06:03:11 GMT
I have one 500GB plain-text file in HDFS, and I want to copy locally, to
zip it and put it on another machine in a local disk. The problem is that I
don't have enough space in the local disk where HDFS is, to then zip it and
transfer to another host.

Can I split the file into small files to be able to copy to the local disk?
Any suggestions on how to do a copy?

Best regards,

View raw message