bahir-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yanlin-Lynn <>
Subject [GitHub] bahir pull request #72: [BAHIR-183]Using HDFS for saving message for mqtt so...
Date Sun, 02 Dec 2018 03:04:30 GMT
GitHub user yanlin-Lynn opened a pull request:

    [BAHIR-183]Using HDFS for saving message for mqtt source.

    Currently in spark-sql-streaming-mqtt, the received mqtt message is saved in a local file
by driver, this will have the risks of losing data for cluster mode when application master
failover occurs. So add a hdfs-based mqtt source to solve this problem.

You can merge this pull request into a Git repository by running:

    $ git pull bahir-183

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #72
commit eb33741f8b77828815c8f834ec0951d6c39728fc
Author: wangyanlin01 <wangyanlin01@...>
Date:   2018-12-02T03:00:21Z

    [BAHIR-183]Using HDFS for saving message for mqtt source.



View raw message