From dev-return-100704-archive-asf-public=cust-asf.ponee.io@kafka.apache.org Tue Jan 1 21:18:48 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 66D5A18066C for ; Tue, 1 Jan 2019 21:18:48 +0100 (CET) Received: (qmail 80262 invoked by uid 500); 1 Jan 2019 20:18:47 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 80250 invoked by uid 99); 1 Jan 2019 20:18:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Jan 2019 20:18:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 18851C1A85 for ; Tue, 1 Jan 2019 20:18:46 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.798 X-Spam-Level: * X-Spam-Status: No, score=1.798 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id M6-kbxWp6nBW for ; Tue, 1 Jan 2019 20:18:44 +0000 (UTC) Received: from mail-lf1-f48.google.com (mail-lf1-f48.google.com [209.85.167.48]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E236B5FE0C for ; Tue, 1 Jan 2019 20:11:59 +0000 (UTC) Received: by mail-lf1-f48.google.com with SMTP id y14so879575lfg.13 for ; Tue, 01 Jan 2019 12:11:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:from:date:message-id:subject:to; bh=lDnpkxIj3i4I7d080CPYisJcHXCdJ+f0JWjVBqhjXgA=; b=lzgaJRAXsxeSxSPJ2wKL0FAW2aWfBNeQomsMGUqVdQKztM+E66w1Bl/AUhg1MnQ9NZ +6A1a0UaBFEbeph0VTsRquCK8uUVS+BC/ocRy0LyPqTlGGncySmasgR+svA4CMC7rjg+ oOmoNDF3NFEzIQTzYRoq747WNtlnVRTfZLV5Jj8Y3I/5BX5+dPBwGj9emjzls03ZwJsw 1GhWfya3sXrN5mcEqE+DDw7J1kRe2bczaLXoqt9ntff2jBZg69o5mlsGtdUNoXrBjKJn AxkDlPY1H7HKvS3dVR3eSm2B5SN1Se8YDzOC5gyP41fQeMdjA5COvqOCKzl7izHpdvcD ZbjQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:from:date:message-id :subject:to; bh=lDnpkxIj3i4I7d080CPYisJcHXCdJ+f0JWjVBqhjXgA=; b=n2yQEDbT3nN0Ifz72HAm6EppE5dtVn5PsYhNxNF6t/qyBWeWeJaRwS5KaHeKKI6mVs QvIKFFs1pUa+VMvgWohtjbITi5WdUc3gHS+xFgLZ64GYQpy3M3vuZbA5BeDdyyh1dyt+ Jr6g17P20pn1/nkCe8u+2thzkyZqSG6VV33eiQfFHII0fFDqSiwewt7pgtlxTkPivl0m ml65VyTKj5At+CtAw85u8BbGagW22eyoXLkFUkNUgiUZfoDcU3VP3qMdlMBSfHZq1yIk F/oNi7txTLD9MCJ7nObLXchkLGHc2pAdk7b7EIXAKQa1HnvWnPxi98HAp82fqZnqt89c bjCA== X-Gm-Message-State: AJcUukdQJhV7lO9h9m3TR0KlCwt/od8SN1zX8WfWCHhYmpFKVxOqZfju QfYaQsJ6p07/T29x9buRPbisuneeT4Ukhff5fX9DfwPU X-Google-Smtp-Source: ALg8bN45/4tqwkttAtp+94U+F5AaOYNMv5QAqumYBHMGFTQxtqESaFDpCGKDRxVv2dRYo4qgLOO4Mt5t4hcy/5YtElY= X-Received: by 2002:a19:2906:: with SMTP id p6mr4360978lfp.17.1546373518375; Tue, 01 Jan 2019 12:11:58 -0800 (PST) MIME-Version: 1.0 Reply-To: pere.urbon@gmail.com From: =?UTF-8?Q?Pere_Urb=C3=B3n_Bayes?= Date: Tue, 1 Jan 2019 21:11:47 +0100 Message-ID: Subject: [Discuss] Question on KIP-298: Error Handling in Kafka Connect To: dev@kafka.apache.org Content-Type: multipart/alternative; boundary="00000000000040bee3057e6b24b5" --00000000000040bee3057e6b24b5 Content-Type: text/plain; charset="UTF-8" Hi, a quick question on the KIP-298 Dead letter queue, as I read from the KIP is only available for the Sink connectors. While I know the challenges of defining a dead-letter queue for the incoming messages, I wanted ask/discuss what is the sense in here for this, do you completely discard the option? I sort of see it useful for messages that where pulled from the source, but somehow could not be ingested in Kafka, might be because of serialisation for example. What do you think? -- Pere Urbon-Bayes Software Architect http://www.purbon.com https://twitter.com/purbon https://www.linkedin.com/in/purbon/ --00000000000040bee3057e6b24b5--