hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jaideep Dhok (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4570) More information to user on GetOperationStatus in Hive Server2 when query is still executing
Date Wed, 22 May 2013 10:00:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13663978#comment-13663978
] 

Jaideep Dhok commented on HIVE-4570:
------------------------------------

Please give your feedback on the below changes -

Current API GetOperationState is not enough since it returns only a state enum. Instead of
changing that we can add new API GetOperationProgress() which will return both OperationState
and OperationProgress.

Driver maintains list of running and runnable tasks although that info is not exposed outside.
It's kept locally in the driver's execute method. We can add Driver.getTaskProgressList()
to return task progress reports on all tasks (both running and runnable)

Proposed changes -
{noformat}
// new method in TCLIService.thrift
OperationProgress GetOperationProgress(OperationHandle)
// new types -
OperationProgress, TaskProgress and MapRedTaskProgress

1.  OperationProgress:
class OperationProgress {
  OperationState getOperationState(),
  List<TaskProgress> getTaskProgress();
}

2.class TaskProgress {
  public float getProgress() {
    return 0;
  }
  public String getTaskID() {
    return "N/A";
  }
}

3. class MapRedTaskProgress extends TaskProgress {
  public float mapProgress();
  public float reduceProgress();
  public String getTaskID() {
     return runningJob.getID().toString();
  }
}

4. New method in Task:
  public TaskProgress getTaskProgress() {
    return 0; // default to 0
  }

5. Override getTaskProgress in MapRedTask to return a MapRedTaskProgress
{noformat}
                
> More information to user on GetOperationStatus in Hive Server2 when query is still executing
> --------------------------------------------------------------------------------------------
>
>                 Key: HIVE-4570
>                 URL: https://issues.apache.org/jira/browse/HIVE-4570
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>    Affects Versions: 0.11.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Jaideep Dhok
>
> Currently in Hive Server2, when the query is still executing only the status is set as
STILL_EXECUTING. 
> This issue is to give more information to the user such as progress and running job handles,
if possible.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message