hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shanyu zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6130) Webhcat resource /templeton/v1/status doesn't track Hive job progress
Date Wed, 05 Feb 2014 22:38:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13892683#comment-13892683
] 

shanyu zhao commented on HIVE-6130:
-----------------------------------

[~shuainie] I think you should remove this line, we shouldn't call flush() for every line
in stdout, this will cause performance issue. For example, flush() will cause a packet being
sent out for WASB file system.
+          writer.flush();

Also, is this change intended?
-  public static final Pattern HIVE_COMPLETE = Pattern.compile(" map = \\d+%,\\s+reduce =
\\d+%$");
+  public static final Pattern HIVE_COMPLETE = Pattern.compile(" map = \\d+%,\\s+reduce =
\\d+%");



> Webhcat resource /templeton/v1/status doesn't track Hive job progress
> ---------------------------------------------------------------------
>
>                 Key: HIVE-6130
>                 URL: https://issues.apache.org/jira/browse/HIVE-6130
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Shuaishuai Nie
>         Attachments: HIVE-6130.1.patch
>
>
> Problem: Unable to track Hive job progress through webhcat.
> Cause:
> TempletonUtils has code to parse PIG and JAR child jobid and percentage progress but
none for Hive jobs. extractPercentComplete() and extractChildJobId() are supposed to do this
parsing. 
> Effect:
> /templeton/v1/queue/$job_id?user.name=$user returns no job progress info. The jobid param
in the json result that's supposed to contain the child hive jobid contains the templetoncontrollerjob
id instead leaving the parent jobid null.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message