Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 892F3181A3 for ; Sun, 11 Oct 2015 19:54:21 +0000 (UTC) Received: (qmail 89689 invoked by uid 500); 11 Oct 2015 19:54:18 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 89561 invoked by uid 500); 11 Oct 2015 19:54:17 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 89550 invoked by uid 99); 11 Oct 2015 19:54:17 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 11 Oct 2015 19:54:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 3E902C246E for ; Sun, 11 Oct 2015 19:54:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 04epTgE_tpHj for ; Sun, 11 Oct 2015 19:54:16 +0000 (UTC) Received: from mail-ig0-f180.google.com (mail-ig0-f180.google.com [209.85.213.180]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 52B9A439BE for ; Sun, 11 Oct 2015 19:54:16 +0000 (UTC) Received: by igcpe7 with SMTP id pe7so68551856igc.0 for ; Sun, 11 Oct 2015 12:54:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=yV7ltlgz1EWDN9eDifyYNarOxiLqVm2kNz7blOPUA6o=; b=GgSWSNRz/d4Rh99hZImBi4m6nHb9Zk2ZlG64dmpFNtFkJtJcRLbZpN840DVNCx9g6I v5eYM489V3n5ejrIAVtEU3+8SNXvyda0IJ7qJKVJPHR9PhB5Zl4SPBJrbZI9aesP0IDH Dgu+yi3yrEDxFJXi74L0AloHK66zy4iYKu0j3Rol+V/ZA1yZ4c57Vj84CMGeGUVVQaO1 /6okKYAx0cLMy2D5NEg0YHKeL3Z+Jhe//WF1Dat9wDt9INr/HVmpm7T3gMZT+zcxANcu NF9zZynVI9Hzb2pgA+xo6XBS5roNRHj+U2vZm1jVn+VFCgizSvMnDYkO9iz1V7VDc/JD VVBA== MIME-Version: 1.0 X-Received: by 10.50.111.167 with SMTP id ij7mr8122765igb.41.1444593249850; Sun, 11 Oct 2015 12:54:09 -0700 (PDT) Received: by 10.36.73.196 with HTTP; Sun, 11 Oct 2015 12:54:09 -0700 (PDT) In-Reply-To: References: Date: Mon, 12 Oct 2015 01:24:09 +0530 Message-ID: Subject: Re: Hadoop Development From: hadoop hive To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b414478809be50521d99388 --047d7b414478809be50521d99388 Content-Type: text/plain; charset=UTF-8 Thanks Daniel. On Mon, Oct 12, 2015 at 12:52 AM, Daniel Schulz < danielschulz2005@hotmail.com> wrote: > Hi Vikas, > > Thanks for reaching out to us. > > For local development to me MRUnit is a game changer: you may speed up > your development significantly due to better debugging features. > mrunit.apache.org > > To upload your final jar and start it from a remote host, like Windows, > just use web services REST API of YARN. You may use putty or cmd for that. > > hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html > > Please let us know iff you have further questions about Hadoop. > > Kind regards, Daniel. > > ------------------------------ > Date: Mon, 12 Oct 2015 00:06:50 +0530 > Subject: Hadoop Development > From: hadoophive@gmail.com > To: user@hadoop.apache.org > > > Hi Experts, > > Did anyone have idea how to execute MR on remote cluster. Actually i have > been using windows for hadoop development and i have pseudo distributed > cluster on linux. > > Did anyone have any doc or wrote any blog on this. Please provide some > pointers. > > Thanks > Vikas Srivastava > > > --047d7b414478809be50521d99388 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks Daniel.

On Mon, Oct 12, 2015 at 12:52 AM, Daniel Schulz <danielschulz2005@hotmail.com> wrote:
Hi Vikas,

Thanks for reaching out = to us.

For local development to me MRUnit is a gam= e changer: you may speed up your development significantly due to better de= bugging features.

To upload your final jar and start it from a remote host, like Window= s, just use web services REST API of YARN. Y= ou may use putty or cmd for that.

Please let us know= iff you have further questions about Hadoop.

Kind= regards, Daniel.

Date: Mon, 12 Oct 2015 00:06:50 +0530
= Subject: Hadoop Development
From: hadoophive@gmail.com
To: user@hadoop.apache.org


Hi Experts,

=
Did anyone have idea how to execute MR on remote cluster. Actually i = have been using windows for hadoop development and i have pseudo distribute= d cluster on linux.

Did anyone have any doc or wrote any blog = on this. Please provide some pointers.

Thanks
Vikas S= rivastava



--047d7b414478809be50521d99388--