Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 92E13200AC8 for ; Tue, 7 Jun 2016 18:50:16 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 918B2160A36; Tue, 7 Jun 2016 16:50:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DA2F9160968 for ; Tue, 7 Jun 2016 18:50:15 +0200 (CEST) Received: (qmail 2415 invoked by uid 500); 7 Jun 2016 16:50:15 -0000 Mailing-List: contact user-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@beam.incubator.apache.org Delivered-To: mailing list user@beam.incubator.apache.org Received: (qmail 2405 invoked by uid 99); 7 Jun 2016 16:50:15 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 07 Jun 2016 16:50:15 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 9DE81C0DA6 for ; Tue, 7 Jun 2016 16:50:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.299 X-Spam-Level: * X-Spam-Status: No, score=1.299 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=smokinghand-com.20150623.gappssmtp.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id sVsG6i8aDLsz for ; Tue, 7 Jun 2016 16:50:12 +0000 (UTC) Received: from mail-oi0-f44.google.com (mail-oi0-f44.google.com [209.85.218.44]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id D7F255F233 for ; Tue, 7 Jun 2016 16:50:11 +0000 (UTC) Received: by mail-oi0-f44.google.com with SMTP id e72so286174929oib.1 for ; Tue, 07 Jun 2016 09:50:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=smokinghand-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=ex/rjXgqsIbtJfUxLRScP2L2E0biAv+leq5Njej3uco=; b=ZSh9CPhb/1rOMnhdpvkf3IqqgYcnIn51rcTkYBagXV94sigExw0e4sLAVfN2Dv3ZZ5 3K4xafRHmt5Gkiq0Xolx63B5oP0toA/X3JnNjVDYv1wlDdyLXz3nFJ3b3Fiw4G28Wblu 1RK2W/vc1zJJsMd0yRsptzWvcZLxSsduszYHXiVBeQAHcVKh6uKYQPlcwYqQGpvBPUUj MfAwzw57on1pkN1vfGA1HDvTvBZlM2pn+JNMAPFzBl8+3Na9OyPEfCRr3oM7r404HEtI maP/P9c/cboJo+aYhpr74b9zL4Y6729hYCHcPQ3wcVokuGV055nFMmcegsM3kvI69QPg C+0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=ex/rjXgqsIbtJfUxLRScP2L2E0biAv+leq5Njej3uco=; b=YhtBMW0ZbIfwm2q8AvsV9uBFfbGNAyuzQ1dWA0UMsGHrjm70LJVexSPJkOJbzAHxWW VzbsQLy53Hmh6tMi8SR8o/aJg0xfQf+JHv/H2q14imCs3WwB+XNpn5mwC0dmQrMFrY5W LkKKI9UZTJVKb8/4BhFovyog1WzfiME0xiQ9/rW1K7awAAJEZt9grEzgn3vXfMa2de8H EG+ZeaAj0+ZfGPoitDy4Y3/itQs432wWUxUrThOnlggPr4iQ3IdHidCzJvvqUC+ozLKS vZz2FlRnNdnTDjZaHibeMd6UauAzevROg+pQ8rOg01938kXFQOJmI9yYgtENQmJG+0Yd kNow== X-Gm-Message-State: ALyK8tKiO6K/t8CjvFc/nOLYh97KskJT5baoa5Zk01lIjMa+5GPYDCoN/R8uuToYOfIwhfjs2ij/2Wm0aG7+Ew== X-Received: by 10.157.26.7 with SMTP id a7mr278063ote.117.1465318210762; Tue, 07 Jun 2016 09:50:10 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Jesse Anderson Date: Tue, 07 Jun 2016 16:50:01 +0000 Message-ID: Subject: Re: KafkaIO Writer To: user@beam.incubator.apache.org Content-Type: multipart/alternative; boundary=001a1141c7aa6f94880534b2fbe2 archived-at: Tue, 07 Jun 2016 16:50:16 -0000 --001a1141c7aa6f94880534b2fbe2 Content-Type: text/plain; charset=UTF-8 Ah the over the weekend part explains that. Is there a reason KafkaIO doesn't follow the separate classes for read and write like TextIO does? Following the TextIO style, there should be a KafkaIO.Read.method() or KafkaIO.Write.method(). On Tue, Jun 7, 2016 at 12:22 PM Dan Halperin wrote: > Hi Jesse, > > KafkaIO supports write: > https://github.com/apache/incubator-beam/blob/master/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java#L161 > > (This was merged over the weekend as part of @rangadi's > https://github.com/apache/incubator-beam/pull/271) > > Dan > > On Tue, Jun 7, 2016 at 9:04 AM, Jesse Anderson > wrote: > >> Are there plans to add a writer to KafkaIO? Right now, it's only read. >> >> The class itself is written to only expect a reader. Adding any sort of >> write would require refactoring the class to Read and Write like TextIO >> does. >> >> Thanks, >> >> Jesse >> > > --001a1141c7aa6f94880534b2fbe2 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Ah the over the weekend part explains that.

=
Is there a reason KafkaIO doesn't follow the separate classes for = read and write like TextIO does? Following the TextIO style, there should b= e a KafkaIO.Read.method() or KafkaIO.Write.method().

On Tue, Jun 7, 2016 at 12:22 PM Dan Ha= lperin <dhalperi@google.com&g= t; wrote:

Dan

On Tue, Jun 7, 2016 at 9:04 AM, Jesse Anderson <jes= se@smokinghand.com> wrote:
=
Are there plans to add a writer to KafkaIO? Right now, it&= #39;s only read.

The class itself is written to only exp= ect a reader. Adding any sort of write would require refactoring the class = to Read and Write like TextIO does.

Thanks,
<= div>
Jesse

--001a1141c7aa6f94880534b2fbe2--