hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Kerzner <mark.kerz...@shmsoft.com>
Subject Re: Best practices for adding services to Hadoop cluster?
Date Thu, 07 Mar 2013 05:29:50 GMT
Okay,

then there is nothing wrong with the mapper directly talking to the server,
and failing the map task if the service does not work out.

Thank you,
Mark

On Wed, Mar 6, 2013 at 11:21 PM, Harsh J <harsh@cloudera.com> wrote:

> Can the mapper not directly talk to whatever application server the
> Windows server runs? Is the work needed to be done in the map step
> (i.e. per record)? If not, you can perhaps also consider the SSH
> action of Oozie (although I've never tried it with a Windows machine)
> under a workflow.
>
> On Thu, Mar 7, 2013 at 8:16 AM, Mark Kerzner <mark.kerzner@shmsoft.com>
> wrote:
> > Hi,
> >
> > my Hadop cluster needs help: some tasks have to be done by a Windows
> server
> > with specialized closed-source software. How do I add them to the mix?
> For
> > example, I can run Tomcat, and the mapper would be calling a servlet
> there.
> > Is there anything better, which would be closer to the fault-tolerant
> > architecture of Hadoop itself?
> >
> > Thank you,
> > Mark
>
>
>
> --
> Harsh J
>

Mime
View raw message