hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark N <nipen.m...@gmail.com>
Subject Reading a common library file
Date Tue, 01 Dec 2009 11:16:39 GMT
I need to read and check the entry from a common file ( say a list of words
containing StopWords ) . So that each map function can check these stopwords
from a file.

Should I create a hadoop map file in HDFS  so that it could be searched
faster ? would that be memory overhead as indexes would be loaded into
memory ?

another approach could be a Grep in map/.reduce job

Any suggestions would be appreciated

thanks





-- 
Nipen Mark

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message