beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2162) Add logging during and after long running BigQuery jobs
Date Thu, 04 May 2017 00:26:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995954#comment-15995954
] 

ASF GitHub Bot commented on BEAM-2162:
--------------------------------------

GitHub user bjchambers opened a pull request:

    https://github.com/apache/beam/pull/2882

    [BEAM-2162] Add logging to long BigQuery jobs

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [*] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [*] Make sure tests pass via `mvn clean verify`.
     - [*] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [*] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bjchambers/beam bq-logging

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/2882.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2882
    
----
commit ed5ca43d40cb004fc30b17a4fd70664170a2f246
Author: bchambers <bchambers@google.com>
Date:   2017-05-03T23:40:09Z

    [BEAM-2162] Add logging to long BigQuery jobs

----


> Add logging during and after long running BigQuery jobs
> -------------------------------------------------------
>
>                 Key: BEAM-2162
>                 URL: https://issues.apache.org/jira/browse/BEAM-2162
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-gcp
>            Reporter: Ben Chambers
>            Assignee: Ben Chambers
>            Priority: Minor
>
> Currently, we log when the export job begins, but don't clearly log when it has completed.
> If it takes a long time (over an hour) it would also be useful to periodically log to
remind the reader that the job is still running, and make it clear the pipeline isn't hung,
it's just waiting.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message