hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul H." <pitt_dynam...@yahoo.com>
Subject Hadoop for incremental index building and search
Date Sat, 27 Oct 2007 16:19:02 GMT

According to a hadoop tutorial  (http://wiki.apache.org/nutch/NutchHadoopTutorial) on wiki,

"you don't want to search using DFS, you want to search using local filesystems.
Once the index has been created on the DFS you can use the hadoop
copyToLocal command to move it to the local file system as such".

my understanding is that hadoop is only good for batch index building,
and is not proper for incremental index building and search. Is this
true? By "incremental index building and search", I mean a system that
accepts text on the fly, builds index  and makes the index available
for search immediately. 


Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message