Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A681518D17 for ; Sun, 1 Nov 2015 16:35:26 +0000 (UTC) Received: (qmail 61689 invoked by uid 500); 1 Nov 2015 16:35:22 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 61566 invoked by uid 500); 1 Nov 2015 16:35:22 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 61556 invoked by uid 99); 1 Nov 2015 16:35:22 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 01 Nov 2015 16:35:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id DF133C0FE2 for ; Sun, 1 Nov 2015 16:35:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.901 X-Spam-Level: *** X-Spam-Status: No, score=3.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id YgPBpct_ZwbC for ; Sun, 1 Nov 2015 16:35:12 +0000 (UTC) Received: from mail-wi0-f173.google.com (mail-wi0-f173.google.com [209.85.212.173]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 5D96E444C4 for ; Sun, 1 Nov 2015 16:35:12 +0000 (UTC) Received: by wicfx6 with SMTP id fx6so36585567wic.1 for ; Sun, 01 Nov 2015 08:35:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Bsr6ItLjVNmYuQ8fAtg4sgSvGHFRNL5lVKVuGjjMnX4=; b=Qk8c2mDvuRyMarOs4qLiTNX5yapIFV6RE5P84Jet/KOUTVPCUtpAqtwUkGJRHkFHTW fatXCLXqUJPw4CkRJTgaAflCTY/zoeoOBY8JPEiNwlxlCx0dQ8zBDwbcVKQW+u/PlbEo IEASZrOXt5C9o5QtPz3ieMoaFeR9ybXGwWEcCO6IdAEPIHW7M6QX03fVGfFUKHqZA6Ew Lo9WOa4uhnvb+x/7z5ncW+uno9i+2zUHsBnD3xQzXAhynefoBoge4bzkWIWBp69PUo3l gRQ9iEveMIv2yEtGTUphQYA6gr3AfM78YIU+dCOPNoXGSR5WlQdPdy2n4K0podeHnrp/ x4Ag== MIME-Version: 1.0 X-Received: by 10.194.78.77 with SMTP id z13mr20835835wjw.145.1446395711431; Sun, 01 Nov 2015 08:35:11 -0800 (PST) Received: by 10.27.80.80 with HTTP; Sun, 1 Nov 2015 08:35:11 -0800 (PST) In-Reply-To: References: Date: Sun, 1 Nov 2015 22:05:11 +0530 Message-ID: Subject: Re: Utility to push data into HDFS From: James Bond To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bfcfc9895abeb05237d3ea0 --047d7bfcfc9895abeb05237d3ea0 Content-Type: text/plain; charset=UTF-8 I am guessing this should work - https://stackoverflow.com/questions/9722257/building-jar-that-includes-all-its-dependencies On Sun, Nov 1, 2015 at 8:15 PM, Shashi Vishwakarma wrote: > Hi Chris, > > Thanks for your reply. I agree WebHDFS is one of the option to access > hadoop from windows or *nix. I wanted to know if I can write a java code > will can be executed from windows? > > Ex: java HDFSPut.java <<- this java code should have FSShell cammand > (hadoop fs -ls) written in java. > > In order to execute this , what are list items I should have on windows? > For example hadoop jars etc. > > If you can throw some light on this then it would be great help. > > Thanks > Shashi > > > > > > On Sun, Nov 1, 2015 at 1:39 AM, Chris Nauroth > wrote: > >> Hello Shashi, >> >> Maybe I'm missing some context, but are the Hadoop FsShell commands >> sufficient? >> >> >> http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/FileSystemShell.html >> >> These commands work on both *nix and Windows. >> >> Another option would be WebHDFS, which just requires an HTTP client on >> your platform of choice. >> >> >> http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-hdfs/WebHDFS.html >> >> --Chris Nauroth >> >> From: Shashi Vishwakarma >> Reply-To: "user@hadoop.apache.org" >> Date: Saturday, October 31, 2015 at 5:46 AM >> To: "user@hadoop.apache.org" >> Subject: Utility to push data into HDFS >> >> Hi >> >> I need build a common utility for unix/windows based system to push data >> into hadoop system. User can run that utility from any platform and should >> be able to push data into HDFS. >> >> Any suggestions ? >> >> Thanks >> >> Shashi >> > > --047d7bfcfc9895abeb05237d3ea0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

On Sun, Nov 1, 2015 at 8:15= PM, Shashi Vishwakarma <shashi.vish123@gmail.com> wr= ote:
Hi Chris,

<= /div>
Thanks for your reply. I agree WebHDFS is one of the option to ac= cess hadoop from windows or *nix. I wanted to know if I can write a java co= de will can be executed from windows?

Ex: =C2=A0ja= va HDFSPut.java =C2=A0<<- this java code should have FSShell cammand = (hadoop fs -ls) written in java.=C2=A0

In order to= execute this , what are list items I should have on windows?
For= example hadoop jars etc.

If you can throw some li= ght on this then it would be great help.

Thanks=C2= =A0
Shashi



=C2=A0

On Sun, Nov 1, 2015 at 1:39 AM, Chris Nauroth <cnauroth@hortonwor= ks.com> wrote:
Hello Shashi,

Maybe I'm missing some context, but are the Hadoop FsShell command= s sufficient?

http://hadoop.apache.or= g/docs/r2.7.1/hadoop-project-dist/hadoop-common/FileSystemShell.html

These commands work on both *nix and Windows.

Another option would be WebHDFS, which just requires an HTTP client on= your platform of choice.


--Chris Nauroth<= /font>

From: Shashi Vishwakarma <shashi.vish123@gmai= l.com>
Reply-To: "user@hadoop.apache.org" &= lt;user@hadoop.= apache.org>
Date: Saturday, October 31, 2015 at= 5:46 AM
To: "user@hadoop.apache.org" <user@hadoop.apache= .org>
Subject: Utility to push data into = HDFS

Hi

I need build a common utility for unix/windows based system to push data in= to hadoop system. User can run that utility from any platform and should be= able to push data into HDFS.

Any suggestions ?

Thanks

Shashi


--047d7bfcfc9895abeb05237d3ea0--