nutch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From prateek sachdeva <prats86....@gmail.com>
Subject Apache Nutch 1.16 Fetcher reducers?
Date Mon, 20 Jul 2020 21:38:23 GMT 
Hi Guys,

As per Apache Nutch 1.16 Fetcher class implementation here -
https://github.com/apache/nutch/blob/branch-1.16/src/java/org/apache/nutch/fetcher/Fetcher.java,
this is a map only job. I don't see any reducer set in the Job. So my
question is why not set job.setNumreduceTasks(0) and save the time by
outputting directly to HDFS.

Regards
Prateek
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message