Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 743CCD90C for ; Thu, 18 Oct 2012 22:00:39 +0000 (UTC) Received: (qmail 30304 invoked by uid 500); 18 Oct 2012 22:00:34 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 30195 invoked by uid 500); 18 Oct 2012 22:00:34 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 30187 invoked by uid 99); 18 Oct 2012 22:00:34 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Oct 2012 22:00:34 +0000 X-ASF-Spam-Status: No, hits=-5.0 required=5.0 tests=RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of apamecha@x.com designates 216.33.244.6 as permitted sender) Received: from [216.33.244.6] (HELO rhv-mipot-001.corp.ebay.com) (216.33.244.6) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Oct 2012 22:00:28 +0000 DomainKey-Signature: s=paypalcorp; d=x.com; c=simple; q=dns; h=X-EBay-Corp:X-IronPort-AV:Received:Received:From:To: Subject:Thread-Topic:Thread-Index:Date:Message-ID: References:In-Reply-To:Accept-Language:Content-Language: X-MS-Has-Attach:X-MS-TNEF-Correlator:x-originating-ip: Content-Type:Content-Transfer-Encoding:MIME-Version: X-CFilter-Loop; b=i98WwoTIJsxzSTQy5XB+IjOJad5w+EtAcWoZkfy4gtqxBFrSAwxmrTl0 eJEYEm9FUTSEKHvq3S3rk/P21FNhyRiBHWlHgwbJzUJdbj+hxjEiHCb/V X6F7lcExY8vCnahZYX3A5RJ9MPMDBr5YH4uC0PPG6/Tsz9RvbCDmWkxP9 Y=; DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=x.com; i=apamecha@x.com; q=dns/txt; s=paypalcorp; t=1350597628; x=1382133628; h=from:to:subject:date:message-id:references:in-reply-to: content-transfer-encoding:mime-version; bh=UWoC3WyHWx266zcNooa85Bvog1mwqdMSdM9tvf4CjPE=; b=jy8/Fruqli5Rcgg5mAc7ppxB/kf5Ez+IZSPndJ71u5mrucPWQy6Sw7kx Im8ET26aRDCgNF4ni+AdiJp1oD4o1BWo/NuCG2SFtMiPlxLJpnEulHA2r eF2EGtjoWc/qeUYzc1qQgRmjr+69ZiHgrLi7ectEVyRXewOJuev1gGUwl 8=; X-EBay-Corp: Yes X-IronPort-AV: E=Sophos;i="4.80,606,1344236400"; d="scan'208";a="86825582" Received: from rhv-mexcs-001.corp.ebay.com (HELO RHV-EXMHT-003.corp.ebay.com) ([10.112.113.54]) by rhv-mipot-001.corp.ebay.com with ESMTP; 18 Oct 2012 15:00:06 -0700 Received: from RHV-EXRDA-S11.corp.ebay.com ([fe80::edc0:9413:d700:64f]) by RHV-EXMHT-003.corp.ebay.com ([fe80::814f:de0a:319f:653c%14]) with mapi id 14.02.0318.001; Thu, 18 Oct 2012 15:00:05 -0700 From: "Pamecha, Abhishek" To: "user@hadoop.apache.org" Subject: RE: i am about to scrape a page Thread-Topic: i am about to scrape a page Thread-Index: AQHNrXqgiAOn75vqVUuabv9Vc/dTTpe/nKpg Date: Thu, 18 Oct 2012 22:00:03 +0000 Message-ID: <2E362ACC9493D747B488241C66B3B66520EF59@RHV-EXRDA-S11.corp.ebay.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.245.27.242] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Virus-Checked: Checked by ClamAV on apache.org A little bit better than plain scraping..use lynx.. You don't have to parse HTML at least. Thanks, Abhishek -----Original Message----- From: Patai Sangbutsarakum [mailto:silvianhadoop@gmail.com]=20 Sent: Thursday, October 18, 2012 2:47 PM To: user@hadoop.apache.org Subject: i am about to scrape a page I finding a way to retrieve info about what jobs are running by what user, = and on what pool(s); i am on cdh3u4 with fair scheduler. I do know that jobtracker_host:50030/scheduler is showing that, so scraping the page would be one way and handle with html table. Is that any other more civilized way, json format, command line ? hadoop job -list doesn't show the pool.. that's pretty sad. Input is really appreciate :-) Thanks Patai