hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Carl Steinbach <c...@cloudera.com>
Subject Re: job counters in customized hive map/reduce script.
Date Thu, 07 Apr 2011 18:34:31 GMT
Right now Hive's TRANSFORM mechanism does not allow you set counters.
There's a ticket open for adding this feature:

https://issues.apache.org/jira/browse/HIVE-1649

Thanks.

Carl

On Thu, Apr 7, 2011 at 10:35 AM, Avram Aelony <AvramAelony@eharmony.com>wrote:

>
> Can you try using using streaming from Hive?
>
>        http://wiki.apache.org/hadoop/Hive/LanguageManual/Transform
>
> Cheers,
> ~Avram
>
>
>
> On Apr 7, 2011, at 10:28 AM, Henry Liu wrote:
>
> >
> > I'd like to report some counters in my customized map and reduce ruby
> scripts for hive, just like hadoop streaming does by writing to stderr.
> >
> > Such as.
> >
> >
> >
> >          #increment hadoop counters
> >   $stderr.puts("reporter:counter:Impression,Total,1")
> >   if first_click == 0 && click_details.empty?
> >       $stderr.puts("reporter:counter:Impression,NoClick,1")
> >   end
> >
> >   $stderr.puts ("reporter:status: status rid #{rid}")
> >   $stderr.puts ("test debug message: rid #{rid}")
> >
> >
> > These are all logged as regular messages, no counters/status recognized
> at all.
> >
> > Anyone has any ideas?
> >
> > Thanks.
> >
>
>

Mime
View raw message