hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harish Mallipeddi <harish.mallipe...@gmail.com>
Subject Re: Accessing HDFS over network
Date Thu, 06 Aug 2009 15:27:47 GMT
Why can't you use -copyFromLocal to copy stuff directly from the Windows
machines to HDFS? If you install hadoop on the windows machine, you should
be able to push log files to HDFS (btw the Windows machine doesn't have to
be part of the cluster).

- Harish

On Thu, Aug 6, 2009 at 7:38 PM, thkunkel <thkunkel@gmail.com> wrote:

> Hello,
> I have an HDFS cluster using Ubuntu.
> I want to load IIS logs into the HDFS and then do some processing with
> them.
> The IIS logs come from Windows 2003 servers.
> Currently in Ubuntu I have mounts set up that point to the IIS logs on the
> Windows servers.  From there I copy the logs from the mounts into the HDFS
> using the -copyFromLocal command.
> This works fine enough, but I was wondering if there is a way to share or
> open a folder on the HDFS to the network so that, for example, my Windows
> machines could see it and copy to it directly.
> Is there a way to do that?  Or should I use ssh?
> Thanks much,
> -T
> --
> View this message in context:
> http://www.nabble.com/Accessing-HDFS-over-network-tp24847289p24847289.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.

Harish Mallipeddi

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message