hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Something Something <mailinglist...@gmail.com>
Subject Starting Map Reduce Job on EC2
Date Sun, 15 Jan 2012 08:16:35 GMT
Hello,

Our Hadoop cluster is setup on EC2, but our client machine which will
trigger the M/R job is in our data center.  I am trying to start a M/R job
from our client machine, but getting this:

00:01:16.885 [pool-6-thread-1] INFO  org.apache.hadoop.ipc.Client -
Retrying connect to server:
ec2-xx-xx-xxx-xxx.compute-1.amazonaws.com/xx.xx.xxx.xx:9000. Already tried
0 time(s).
00:01:16.885 [pool-6-thread-1] INFO  org.apache.hadoop.ipc.Client -
Retrying connect to server:
ec2-xx-xx-xxx-xxx.compute-1.amazonaws.com/xx.xx.xxx.xx:9000. Already tried
1 time(s).
00:01:16.885 [pool-6-thread-1] INFO  org.apache.hadoop.ipc.Client -
Retrying connect to server:
ec2-xx-xx-xxx-xxx.compute-1.amazonaws.com/xx.xx.xxx.xx:9000. Already tried
2 time(s).
& so on...


I tried putting our 'pem' file in the classpath, but that didn't help.  I
am assuming it should be possible to trigger a job on EC2 cluster from a
machine that's not in EC2, correct?

Please note that I can trigger a M/R job from the client machine to a
Hadoop running on the same machine - localhost:9000 (hdfs) as well as
localhost:9001 (jobtracker).

Please help.  Thanks.

Mime
View raw message