hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From felix gao <gre1...@gmail.com>
Subject Question on Hadoop 0.20.2 and lzo compression
Date Sat, 11 Dec 2010 01:13:15 GMT
Hi all,

maybe this question does not belong here but let me try it anyway.

I have installed cloudera's 0.20.2 in standalone mode and lzo compression.
 When I run
hadoop jar /usr/lib/hadoop-0.20/lib/hadoop-lzo-0.4.6.jar
com.hadoop.compression.lzo.DistributedLzoIndexer
/user/felix/access_log.2010-08-30-23-00.lzo
10/12/10 19:49:14 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
10/12/10 19:49:14 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library [hadoop-lzo rev fatal: Not a git repository]
10/12/10 19:49:14 INFO lzo.DistributedLzoIndexer: Adding LZO file
/user/felix/access_log.2010-08-30-23-00.lzo to indexing list (no index
currently exists)
10/12/10 19:49:14 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
10/12/10 19:49:15 INFO input.FileInputFormat: Total input paths to process :
1
10/12/10 19:49:15 INFO mapred.JobClient: Running job: job_201012091925_0004
10/12/10 19:49:16 INFO mapred.JobClient:  map 0% reduce 0%

the job got stuck on this line forever.


if I ran with
hadoop jar /usr/lib/hadoop-0.20/lib/hadoop-lzo-0.4.6.jar
com.hadoop.compression.lzo.LzoIndexer
/user/felix/access_log.2010-08-30-23-00.lzo
10/12/10 20:00:05 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
10/12/10 20:00:05 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library Ähadoop-lzo rev fatal: Not a git repositoryÅ
10/12/10 20:00:06 INFO lzo.LzoIndexer: ÄINDEXÅ LZO Indexing file
/user/felix/access_log.2010-08-30-23-00.lzo, size 2.47 GB...
10/12/10 20:00:20 INFO lzo.LzoIndexer: Completed LZO Indexing in 14.19
seconds (178.62 MB/s).  Index size is 100.05 KB.

So anyone can tell me what is going on there?

Thanks,

Felix

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message