flume-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From szabofe...@apache.org
Subject flume git commit: FLUME-2723 batch size trans cap doc update
Date Fri, 23 Nov 2018 10:15:13 GMT
Repository: flume
Updated Branches:
  refs/heads/trunk 19fc3f41e -> 23473e1d5


FLUME-2723 batch size trans cap doc update

An update to the configuration section of the user guide.

This closes #246

Reviewers: Peret Turcsanyi, Ferenc Szabo

(Endre Major via Ferenc Szabo)


Project: http://git-wip-us.apache.org/repos/asf/flume/repo
Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/23473e1d
Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/23473e1d
Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/23473e1d

Branch: refs/heads/trunk
Commit: 23473e1d5b08e1f40be49d66da64f89c1d7a1c68
Parents: 19fc3f4
Author: Endre Major <emajor@cloudera.com>
Authored: Fri Nov 23 11:13:57 2018 +0100
Committer: Ferenc Szabo <szaboferee@apache.org>
Committed: Fri Nov 23 11:13:57 2018 +0100

----------------------------------------------------------------------
 flume-ng-doc/sphinx/FlumeUserGuide.rst | 9 +++++++++
 1 file changed, 9 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/flume/blob/23473e1d/flume-ng-doc/sphinx/FlumeUserGuide.rst
----------------------------------------------------------------------
diff --git a/flume-ng-doc/sphinx/FlumeUserGuide.rst b/flume-ng-doc/sphinx/FlumeUserGuide.rst
index 58164a5..492d90e 100644
--- a/flume-ng-doc/sphinx/FlumeUserGuide.rst
+++ b/flume-ng-doc/sphinx/FlumeUserGuide.rst
@@ -853,6 +853,15 @@ the commands including the passwords will be saved to the command history.)
   performed on the truststore when it is opened by the JDK.
 
 
+Source and sink batch sizes and channel transaction capacities
+--------------------------------------------------------------
+
+Sources and sinks can have a batch size parameter that determines the maximum number of events
they
+process in one batch. This happens within a channel transaction that has an upper limit called
+transaction capacity. Batch size must be smaller than the channel's transaction capacity.
+There is an explicit check to prevent incompatible settings. This check happens
+whenever the configuration is read.
+
 Flume Sources
 -------------
 


Mime
View raw message