hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vetle Roeim" <vet...@opera.com>
Subject Re: Can Hadoop deal with several files on DFS as input?
Date Mon, 25 Sep 2006 11:41:37 GMT
On Mon, 25 Sep 2006 12:04:18 +0200, 张茂森 <maosen.zhang@alibaba-inc.com>  

> Hi all:
> I want to process several logs files (which are collected from several
> severs) on hadoop, nor combine those files before import them into DFS
> system. Could it be carried out?

Works fine for me. I add logs from multiple servers into the DFS, and then  
use  JobConf.addInputPath(Path) when configuring the job to add all  
relevant log files.

Vetle Roeim
Team Manager, Information Systems
Opera Software ASA <URL: http://www.opera.com/ >

View raw message