Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Wed, 5 Oct 2011 21:36:31 +0000 (UTC)
From: "He Yongqiang (Updated) (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <620922445.926.1317850591949.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <572879018.28381.1316035449242.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Updated] (HIVE-2446) Introduction of client statistics
 publishers possibility
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


     [ https://issues.apache.org/jira/browse/HIVE-2446?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:all-tabpanel ]

He Yongqiang updated HIVE-2446:
-------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

move the fix to a new jira ticket
               =20
> Introduction of client statistics publishers possibility
> --------------------------------------------------------
>
>                 Key: HIVE-2446
>                 URL: https://issues.apache.org/jira/browse/HIVE-2446
>             Project: Hive
>          Issue Type: Improvement
>          Components: Clients, Statistics
>            Reporter: Robert Sur=C3=B3wka
>            Assignee: Robert Sur=C3=B3wka
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2446.1.patch, HIVE-2446.1.patch, HIVE-2446.2.pa=
tch, HIVE-2446.2.patch, HIVE-2446.3.patch, HIVE-2446.3.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The purpose of this change is to allow publication or storage of counters=
 while the job is running.
> Introduced two new variables to hive-default.xml and HiveConf.java: "hive=
.client.stats.publishers" and "hive.client.stats.counters". First one speci=
fies classes names, whose instances will be executed by HadoopJobExecHelper=
.java (similarly as hooks are) in its method progress(ExecDriverTaskHandle)=
: MapRedStats. Second one specifies list of counters that any client stat p=
ublishers should publish or stored. Details regarding format of this list i=
s up to a specific deployment (it is up to client stats publishers to parse=
 it), yet it is required to use display names of counter groups and counter=
s.
> Added interface ClientStatsPublishers in org.apache.hadoop.hive.ql.stats =
package, that must be implemented by all stats publishers.
> Added code to progress(ExecDriverTaskHandle): MapRedStats from HadoopJobE=
xecHelper.java that puts counters' values to a Java map and then executes r=
egistered client stats publishers giving them that map and running job id. =
Added two new methods to HadoopJobExecHelper: extractAllCounterValues(Count=
ers) and getClientStatsPublishers() that are used by code from previous sen=
tence.
> Made cosmetic changes in two other classes
> =20

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs: https://issues.apache.org/jira/secure/ContactAdministrators!default.jsp=
a
For more information on JIRA, see: http://www.atlassian.com/software/jira