bookkeeper-distributedlog-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (DL-91) Be able to close writer within a timeout duration
Date Tue, 13 Dec 2016 02:44:59 GMT


ASF GitHub Bot commented on DL-91:

GitHub user sijie opened a pull request:

    DL-91: Be able to close writer within a timeout duration

    merge twitter's change on closing writer.

You can merge this pull request into a Git repository by running:

    $ git pull merge/DL-96

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #63
commit 904b8986b46fc908cfd1a0ee05b35dce77d12f5c
Author: Jordan Bull <>
Date:   2016-05-13T18:27:19Z

    when publishing per partition stats, also publish per stream stats

commit 00919605f1bfa3f3e0c8514dc63552df4eeb3cc2
Author: Jordan Bull <>
Date:   2016-05-18T17:18:34Z

    use zero padded partition strings in stats

commit 7b46a9ac6bb5d520366069c244332347ef019e8e
Author: Sijie Guo <>
Date:   2016-05-23T23:49:19Z

    Improve handling of lock conflicts in zk session lock
    - lock reacquire could happen in foreground and background thread. so use a semaphore
to make sure there is only on e outstanding  acquire operation. and  check if already hold
lock before reacquire.
    - fix handling zk sibling znode logic. as the znode is sequential znode, the name would
be different each time. so only comparing the client id and session id of the znodes

commit 517c77c164cb989ae9829cbd80bf2e492eb8e364
Author: Leigh Stewart <>
Date:   2016-12-13T00:33:33Z

    Introduce periodic keepalive control record in writer
        * so the writer will periodically write 'keepalive' control record to make sure the
stream is alive. so if the write proxy is disconnected from bookies, the control record will
fail to write hence write proxy gets a chance to drop the ownership.

commit b571d3b4adcc140acca881979782474c27459d34
Author: Sijie Guo <>
Date:   2016-05-24T04:01:57Z

    DL: remove watches when unregister children watches

commit 98dc9ab2df8af7af26ca68dbe93be3d420cda417
Author: Sijie Guo <>
Date:   2016-05-27T00:06:31Z

     Remove watcher only when it registered watcher
     (reduce the annoying logging from zookeeper client about "Failed to find watcher!"

commit d3a97bc0dde0c25516840725599ac46fa03601ab
Author: Dave Rusek <>
Date:   2016-06-06T23:50:25Z

    dl: add flag to enable thrift mux on DL Client

commit 800b867b705a786094b9a591e0ebc64fa934f632
Author: Dave Rusek <>
Date:   2016-12-13T00:41:47Z

    Don't use stack and codec together for configuring thriftmux
    - Don't use stack and codec together for configuring thriftmux
    - Remove codec if the thriftmux is disabled

commit 0a18f564ba7e4d03f4c6a0859e5478535a59befd
Author: Leigh Stewart <>
Date:   2016-12-13T00:46:11Z

    Be able to close the writer within a timeout period

commit f19e7564ff4a1ec1b5d6f2683db190d739df99bb
Author: Leigh Stewart <>
Date:   2016-12-13T00:49:26Z

    Simplify the state transition on stream
    * the stream is created on INITIALIZING
    * when the stream is started, it would start transition from INITIALIZING to INITIALIZED
    * it would serve stream operations when the stream is INITIALIZED
    * it would be turned to ERROR when encountered exceptions.
    * the stream would be closed when service operation timeout or encountered any exceptions.
it would first be removed from acquired mapping
    * the stream would be removed from cached mapping depends on probation time.

commit f008f751ec0a020a670903b01c709007ada87381
Author: Sijie Guo <>
Date:   2016-07-08T22:22:55Z

    Allow configuring flush interval in micros for distributedlog multi streams writer

commit 72a786e78540fb5a3f8e27f9d71d3616d06d1548
Author: Sijie Guo <>
Date:   2016-07-11T17:10:55Z

    LogSegmentMetadataStore should only notify when the list of log segments is updated
    Currently it notifies the listeners not only when there is a change but also when session
expires. it would break the readahead loop and cause readers have to wait until it is able
to connect to zookeeper again.
    With this change, it would only notify when the list of log segments is updated. If it
disconnects to zookeeper, the listener won't be notified and it would keep reading from the
log segments it knows.

commit f18fe172fb4559bcabb7173d1cd0b9d27fc23c93
Author: Sijie Guo <>
Date:   2016-07-11T17:21:44Z

    Make the zookeeper client used by bookkeeper client retry on session expires
    * the zookeeper client used by bookkeeper client is purely for metadata accesses, so we
should retry on session expires.
    * remove the unnessary zookeeper session handling in bk log handler. as we don't necessary
to fail bookkeeper client or log handler when session expires as it would be handled and retried
by the zookeeper client.
    * Make the retry infinitely if the retry settings for bkc zookeeper client is set to 0
or negative.

commit f4f633fe655e7146d5aad89c24f7e7107ab65ab2
Author: Leigh Stewart <>
Date:   2016-12-13T00:59:38Z

    Assign host ip client id if the client id is undefined

commit b7ae590e8b819ae63c0139611320dcc0d27e39f7
Author: Leigh Stewart <>
Date:   2016-12-13T01:01:43Z

    Remove unused methods in BKLogHandler


> Be able to close writer within a timeout duration
> -------------------------------------------------
>                 Key: DL-91
>                 URL:
>             Project: DistributedLog
>          Issue Type: Bug
>          Components: distributedlog-client
>            Reporter: Sijie Guo
>            Assignee: Leigh Stewart
> If a stream is hanging on closing the writer on write proxy, it will cause STEAM_UNAVAILABLE.

This message was sent by Atlassian JIRA

View raw message