flume-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hshreedha...@apache.org
Subject flume git commit: FLUME-2665. Update documentation for hdfs.closeTries based on FLUME-2586
Date Tue, 14 Apr 2015 23:22:22 GMT
Repository: flume
Updated Branches:
  refs/heads/trunk 94f568b96 -> 4188e4ded


FLUME-2665. Update documentation for hdfs.closeTries based on FLUME-2586

(Johny Rufus via Hari)


Project: http://git-wip-us.apache.org/repos/asf/flume/repo
Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/4188e4de
Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/4188e4de
Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/4188e4de

Branch: refs/heads/trunk
Commit: 4188e4dedb4af0792bfac3086e3b2a7d415f2248
Parents: 94f568b
Author: Hari Shreedharan <hshreedharan@apache.org>
Authored: Tue Apr 14 16:21:26 2015 -0700
Committer: Hari Shreedharan <hshreedharan@apache.org>
Committed: Tue Apr 14 16:22:23 2015 -0700

----------------------------------------------------------------------
 flume-ng-doc/sphinx/FlumeUserGuide.rst | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/flume/blob/4188e4de/flume-ng-doc/sphinx/FlumeUserGuide.rst
----------------------------------------------------------------------
diff --git a/flume-ng-doc/sphinx/FlumeUserGuide.rst b/flume-ng-doc/sphinx/FlumeUserGuide.rst
index 43ca5db..8d91cec 100644
--- a/flume-ng-doc/sphinx/FlumeUserGuide.rst
+++ b/flume-ng-doc/sphinx/FlumeUserGuide.rst
@@ -1728,10 +1728,10 @@ hdfs.roundValue         1             Rounded down to the highest
multiple of th
 hdfs.roundUnit          second        The unit of the round down value - ``second``, ``minute``
or ``hour``.
 hdfs.timeZone           Local Time    Name of the timezone that should be used for resolving
the directory path, e.g. America/Los_Angeles.
 hdfs.useLocalTimeStamp  false         Use the local time (instead of the timestamp from the
event header) while replacing the escape sequences.
-hdfs.closeTries         0             Number of times the sink must try to close a file.
If set to 1, this sink will not re-try a failed close
+hdfs.closeTries         0             Number of times the sink must try renaming a file,
after initiating a close attempt. If set to 1, this sink will not re-try a failed rename
                                       (due to, for example, NameNode or DataNode failure),
and may leave the file in an open state with a .tmp extension.
-                                      If set to 0, the sink will try to close the file until
the file is eventually closed
-                                      (there is no limit on the number of times it would
try).
+                                      If set to 0, the sink will try to rename the file until
the file is eventually renamed (there is no limit on the number of times it would try).
+                                      The file may still remain open if the close call fails
but the data will be intact and in this case, the file will be closed only after a Flume restart.
 hdfs.retryInterval      180           Time in seconds between consecutive attempts to close
a file. Each close call costs multiple RPC round-trips to the Namenode,
                                       so setting this too low can cause a lot of load on
the name node. If set to 0 or less, the sink will not
                                       attempt to close the file if the first attempt fails,
and may leave the file open or with a ".tmp" extension.


Mime
View raw message