Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B28BE200D66 for ; Fri, 29 Dec 2017 22:41:34 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id B129F160C33; Fri, 29 Dec 2017 21:41:34 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0BA5F160C16 for ; Fri, 29 Dec 2017 22:41:33 +0100 (CET) Received: (qmail 6322 invoked by uid 500); 29 Dec 2017 21:41:33 -0000 Mailing-List: contact dev-help@edgent.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@edgent.apache.org Delivered-To: mailing list dev@edgent.apache.org Received: (qmail 6309 invoked by uid 99); 29 Dec 2017 21:41:33 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Dec 2017 21:41:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 7D7ABC043F for ; Fri, 29 Dec 2017 21:41:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id NF8HstsXA2G1 for ; Fri, 29 Dec 2017 21:41:31 +0000 (UTC) Received: from mail-ua0-f169.google.com (mail-ua0-f169.google.com [209.85.217.169]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C19505F3CC for ; Fri, 29 Dec 2017 21:41:30 +0000 (UTC) Received: by mail-ua0-f169.google.com with SMTP id x10so7247453ual.8 for ; Fri, 29 Dec 2017 13:41:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=VWWpp3qhqi9LIO4rHqzTQk/h5g9iJ0VktANELfq91sg=; b=NH5BWmtePIXHhi3vg3Bmk0LdpIDcH/wUiRn1Tt2ZsaGKLLGEWl7Cdb78/LbyADiSp5 g0GQTC8vyJKjd0dUYr/moXQyxI5opTF0oaUqkKGNbcV/4JEE4dSAljXaR4LGJtXCXBek 5TEU6eTarJX8MaMctpyNOHyF0GWGRyyuOb9VXZ7LcDKVpJSllWf6EJPIssIOVS1BmAZG XyynsR+mjtPAHBKQOI3IJWGxyqJ9I99hFnwaUdXGo3iLF4JmAt2fmKOCv4zj76Ay734u axY+0QKYz1I0hK7/fKAII6+q1FzhLPN4InyoIrxMofreS4yFzHYkwlaSaftUCQsc1Z8P /GdA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=VWWpp3qhqi9LIO4rHqzTQk/h5g9iJ0VktANELfq91sg=; b=GogLyTzFBJPCWg6EXNZel8rlQNLNo7vijyJZxnao5mqNUcdu6gHLGu3hlWj5fFQefP 4Br+3/sZXzet42/HPN90cgmhPzui4ITOvsFuK8h02AfBNPcb+uWs87NJ2/d/riGBUo22 o5uXA5baZ47yjoZgoawpz4vsNhe10TCyURgGGs+JEWtkVi/JIEILg1hXgASEU/g4EV5R qYLG5GYIKhkrsCPG1HIWlm+dMc+fm4NT7mb7xtVMwEFjq+m/F79S3dVYzluss9zwfGGa Gr4qZcY9KIlUx2OkoCkH2yKOO/BzLsfEJ+dxulcPHlR9l2Nx5xKeiRwybY8vCXQIylvX WvYg== X-Gm-Message-State: AKGB3mJADpEOsnR5K159F4BifbXA41Ayg5AdBIL2YJxr34U24iXj3miw fsVPFettyOPEs/+GopS3t+QJBIpkx/wdmnUI1Lg= X-Google-Smtp-Source: ACJfBouVEuZNxngvmc3XLMCV1yWCvJu9ygiPEYrneSSZqAXWFOHY6hM7vbOFm5i4JkcwLoDcJqcVK+admiCpuy1MRQ8= X-Received: by 10.176.80.24 with SMTP id b24mr21307796uaa.187.1514583683836; Fri, 29 Dec 2017 13:41:23 -0800 (PST) MIME-Version: 1.0 Received: by 10.103.115.195 with HTTP; Fri, 29 Dec 2017 13:41:23 -0800 (PST) From: =?UTF-8?Q?Otis_Gospodneti=C4=87?= Date: Fri, 29 Dec 2017 16:41:23 -0500 Message-ID: Subject: Buffering on the edge (network issues) To: dev@edgent.apache.org Content-Type: multipart/alternative; boundary="94eb2c190cba7530210561817e2d" archived-at: Fri, 29 Dec 2017 21:41:34 -0000 --94eb2c190cba7530210561817e2d Content-Type: text/plain; charset="UTF-8" Hi, I tried looking through the API and examples to see if there is Edgent has any built-in buffering capabilities for when the sink cannot be reached for whatever reason. I couldn't find anything like that. Is that something that one would have to write for each (new or custom) connector or is that a part of the framework and I just missed it? If I missed it, how is buffering implemented? In-memory or on persistent media or some hybrid? Can one define the max buffer capacity in terms of either number of items or bytes? If so, are the oldest items in the buffer dropped when the max capacity (or their age) is reached? Thanks, Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ --94eb2c190cba7530210561817e2d--