hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Vyas <jayunit...@gmail.com>
Subject Re: Sorting huge text files in Hadoop
Date Fri, 15 Feb 2013 19:29:38 GMT
well.. ok... i guess you could have a 1TB block do an in place sort on the
file, write it to a tmp directory, and then spill the records in order or
something.  at that point might as well not use hadoop.

View raw message