hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmad Shahzad <ashahz...@gmail.com>
Subject Re: Is it possible ....!!!
Date Tue, 08 Jun 2010 14:24:40 GMT
    Reason for doing that is that i want all the communication to happen
through a communication library that resolves every communication problem
that we can have e.g firewalls, NAT, non routed paths, multi homing etc etc.
By using that library all the headache of communication will be gone. So, we
will be able to use hadoop quite easily and there will be no communication

Thats my master's project. So, i want to know how to start and where to look

Ahmad Shahzad

On Tue, Jun 8, 2010 at 3:48 PM, Segel, Mike <msegel@navteq.com> wrote:

> Is it possible?
> Sure.
> But why? What's your use case?
> -----Original Message-----
> From: Ahmad Shahzad [mailto:ashahzad4@gmail.com]
> Sent: Tuesday, June 08, 2010 6:30 AM
> To: general@hadoop.apache.org
> Subject: Is it possible ....!!!
> Hi,
>    I wanted to ask if it is possible to intercept every communication that
> takes place between hadoop's map reduce task i.e between JobTracker and
> TaskTracker and make it pass through my own communication library.
> So, if JobTracker and TaskTracker talk through http or rpc, i would like to
> intercept the call and let it pass through my communication library. If it
> is possible can anyone tell me that which set of classes i need to look at
> hadoop's distribution.
> Similarly, for the hdfs, is it possible to let all the communication that
> is
> happening between namenode and datanode to pass through my communication
> library.
> Regards,
> Ahmad Shahzad
> The information contained in this communication may be CONFIDENTIAL and is
> intended only for the use of the recipient(s) named above.  If you are not
> the intended recipient, you are hereby notified that any dissemination,
> distribution, or copying of this communication, or any of its contents, is
> strictly prohibited.  If you have received this communication in error,
> please notify the sender and delete/destroy the original message and any
> copy of it from your computer or paper files.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message