hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stanley Xu <wenhao...@gmail.com>
Subject Is there anyway I could use ClusterMapReduceTestCase with the 0.20 new API?
Date Mon, 13 Jun 2011 12:26:06 GMT
Dear All,

I am trying to write a test case for my mapreduce job, which use the new api
in 0.20(using the mapreduce packege rather than the mapred package). For the
mapper used the distributed cache, so I could not use the mrunit to do the
test. I thought I could use the ClusterMapReduceTestCase to set up a mini
cluster for testing.

But it looks that if I just call the job.waitForCompletion, it tried to find
the input path from the local file system rather than the hdfs created by
the mini cluster. I am wondering if there is anything I could do to run the
hadoop 0.20 new api on the cluster created by the ClusterMapReduceTestCase?

Thanks in advance.

Best wishes,
Stanley Xu

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message