hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vetle Roeim" <vet...@opera.com>
Subject Re: Can Hadoop deal with several files on DFS as input?
Date Mon, 25 Sep 2006 11:41:37 GMT
On Mon, 25 Sep 2006 12:04:18 +0200, 张茂森 <maosen.zhang@alibaba-inc.com>  
wrote:

> Hi all:
>
> I want to process several logs files (which are collected from several
> severs) on hadoop, nor combine those files before import them into DFS
> system. Could it be carried out?

Works fine for me. I add logs from multiple servers into the DFS, and then  
use  JobConf.addInputPath(Path) when configuring the job to add all  
relevant log files.


-- 
Vetle Roeim
Team Manager, Information Systems
Opera Software ASA <URL: http://www.opera.com/ >

Mime
View raw message