hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shi Yu <sh...@uchicago.edu>
Subject Re: How to create an archive-file in Java to distribute a MapFile via Distributed Cache
Date Fri, 04 May 2012 12:41:31 GMT

My humble experience:  I would prefer specifying the files in 
command line using -files option, then treat them explicitly in 
the Mapper configure or setup function using 

File f1 = new File("file1name");
File f2 = new File("file2name");

Cause I am not 100% sure how does distributed cached determine 
the order of paths (archives) stored in the array.  I once 
messed up at this point so from then on I stick on the old 
method. 

Mime
View raw message