hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "anishek (JIRA)" <>
Subject [jira] [Commented] (HIVE-17595) Correct DAG for updating the for a database during bootstrap load
Date Tue, 31 Oct 2017 09:55:00 GMT


anishek commented on HIVE-17595:

* Added a note as to why this change is needed ?
* changed the file names 
* there is separate conditions that lead to execution of createEndReplLogTask, it is done
after all the tasks are done as part of 
      boolean addAnotherLoadTask = iterator.hasNext() || loadTaskTracker.hasReplicationState()
          || constraintIterator.hasNext();
      createBuilderTask(scope.rootTasks, addAnotherLoadTask);
      if (!iterator.hasNext() && !constraintIterator.hasNext()) {
        loadTaskTracker.update(updateDatabaseLastReplID(maxTasks, context, scope));

> Correct DAG for updating the for a database during bootstrap load
> ------------------------------------------------------------------------------
>                 Key: HIVE-17595
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 3.0.0
>            Reporter: anishek
>            Assignee: anishek
>             Fix For: 3.0.0
>         Attachments: HIVE-17595.0.patch, HIVE-17595.1.patch, HIVE-17595.2.patch
> We update the as a database property. This is done after all the bootstrap
tasks to load the relevant data are done and is the last task to be run. however we are currently
not setting up the DAG correctly for this task. This is getting added as the root task for
now where as it should be the last task to be run in a DAG. This becomes more important after
the inclusion of 
> HIVE-17426 since this will lead to parallel execution and incorrect DAG's will lead to
incorrect results/state of the system. 

This message was sent by Atlassian JIRA

View raw message