From user-return-73454-archive-asf-public=cust-asf.ponee.io@spark.apache.org Tue Jan 30 16:08:28 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 4084118061A for ; Tue, 30 Jan 2018 16:08:28 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 30444160C53; Tue, 30 Jan 2018 15:08:28 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 51D1F160C42 for ; Tue, 30 Jan 2018 16:08:27 +0100 (CET) Received: (qmail 69956 invoked by uid 500); 30 Jan 2018 15:08:25 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 69946 invoked by uid 99); 30 Jan 2018 15:08:25 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Jan 2018 15:08:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 931F3D3EAB for ; Tue, 30 Jan 2018 15:08:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.285 X-Spam-Level: **** X-Spam-Status: No, score=4.285 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_REPLY=1, HTML_MESSAGE=2, INVALID_MSGID=1.167, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=qq.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id yMgogt0R5ZAf for ; Tue, 30 Jan 2018 15:08:23 +0000 (UTC) Received: from smtpproxy19.qq.com (smtpproxy19.qq.com [184.105.206.84]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id EB19D5F36A for ; Tue, 30 Jan 2018 15:08:21 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qq.com; s=s201512; t=1517324891; bh=+8e8mNlhEDOruSsQsSWmAQ0JTjoWxBF2KnKnpV/Q9bk=; h=Date:From:To:Cc:Subject:References:Mime-Version:Message-ID:Content-Type; b=rJzu72zaozl8PiwJ6weWLtNZpxQtd23kzyQ5Pcf11F7fQ7haleLbnkycfsC+Em9YU sCSXf2okbWmuhrgEkZtunS8kpAWi7jxJR2PlMOouNApleC8y0dPMm5uX9s8LIVSAUl 00JqFZ+e+h0CMKhCqVp3lH3XpNnZisPOJK2GOQAw= X-QQ-mid: esmtp20t1517324890txvn41kgv Received: from DESKTOP-7NMB574 (unknown [125.68.139.104]) by esmtp4.qq.com (ESMTP) with id ; Tue, 30 Jan 2018 23:08:09 +0800 (CST) X-QQ-SSF: 00000000000000F0FO501F00000000V X-QQ-FEAT: 5pbVbGB2o2t7i5Kua5zBECbCUv1Mhmy/IeYO5Y6Hfm8N5Ih/ZOBW6HIshrKR9 8ToseeoGs5ylCZ111GikHPI9eGHIcWgEhShwREm4OYZsq/7mvSdZGi+SC48iZra6CSAWvab 9F8QQdzaK6uOPtCInn918XtuqYnh+qzv8HbduNUC1jyT5CaAuHzGQ4kcRUCYexXZNRnXk2F s4mD+sx5mVNI2zaY1+XDyOvkzGPm1ulOnoMDuq4QpJlqj+c+zlK4GY9XJs3hC7ygYRpGG+P IixEj0eZnBOSXwXqViWifkeRdgp0L3f31B9HbYUOEMMt0O3g9n+0qfQ59V074W7AIQdA== X-QQ-GoodBg: 0 Date: Tue, 30 Jan 2018 23:08:10 +0800 From: "446463844@qq.com" <446463844@qq.com> To: =?GB2312?B?ufnF9LfJ?= Cc: user Subject: =?GB2312?B?u9i4tDogUmU6IHVzZSBrYWZrYSBzdHJlYW1zIEFQSSBhZ2dyZWdhdGUgPw==?= References: <201801302248520466772@qq.com>, <7156EB88-5D19-41AD-9FA2-9E7DDD75336A@126.com> X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7.2.9.89[cn] Mime-Version: 1.0 Message-ID: <201801302308096427535@qq.com>+543E72AA2597E06B Content-Type: multipart/alternative; boundary="----=_001_NextPart786060302667_=----" X-QQ-SENDSIZE: 520 Feedback-ID: esmtp:qq.com:bgforeign:bgforeign3 X-QQ-Bgrelay: 1 ------=_001_NextPart786060302667_=---- Content-Type: text/plain; charset="GB2312" Content-Transfer-Encoding: base64 b2ggc29ycnksDQpJIG1lYW5zIGp1c3QgdXNlIEthZmthIHN0cmVhbXMgQVBJIGRvIHRoZSBhZ2dy ZWdhdGUgYW5kIG5vdCBkZXBlbmQgb24gU3BhcmsgDQoNCg0KDQo0NDY0NjM4NDRAcXEuY29tDQog DQq3orz+yMujuiC5+cX0t8kNCreiy83Ksbzko7ogMjAxOC0wMS0zMCAyMzowNg0KytW8/sjLo7og NDQ2NDYzODQ0QHFxLmNvbQ0Ks63LzaO6IHVzZXINCtb3zOKjuiBSZTogdXNlIGthZmthIHN0cmVh bXMgQVBJIGFnZ3JlZ2F0ZSA/DQoNCmhpLA0KVG9kYXkgSSBkbyBpdCB0b28uDQoNCg0KY2hlY2sg eW91ciBrYWZrYSB2ZXJzaW9uLCB0aGVuIGZvbGxvdyAgb25lIG9mIHRoZSBndWlkZXMgYmVsb3cu DQoNCg0KaHR0cDovL3NwYXJrLmFwYWNoZS5vcmcvZG9jcy9sYXRlc3Qvc3RyZWFtaW5nLWthZmth LTAtOC1pbnRlZ3JhdGlvbi5odG1sDQoNCmh0dHA6Ly9zcGFyay5hcGFjaGUub3JnL2RvY3MvbGF0 ZXN0L3N0cmVhbWluZy1rYWZrYS0wLTEwLWludGVncmF0aW9uLmh0bWwNCg0KDQpodHRwOi8vc3Bh cmsuYXBhY2hlLm9yZy9kb2NzL2xhdGVzdC9zdHJlYW1pbmcta2Fma2EtaW50ZWdyYXRpb24uaHRt bA0KDQoNCg0KDQoNCg0KDQrU2iAyMDE4xOox1MIzMMjVo6zPws7nMTA6NDijrDQ0NjQ2Mzg0NEBx cS5jb20g0LS1wKO6DQoNCkhpDQpJIGFtIG5ldyB0byBrYWZrYS4NCnRvZGF5IEkgdXNlIGthZmth IHN0cmVhbXMgQVBJIGZvciByZWFsIHRpbWluZyBwcm9jZXNzIGRhdGENCmFuZCBJIGhhdmUgbm8g aWRlYSB3aXRoIHRoaXMNCkNhbiBzb21lb25lIGhlbHAgbWUgPw0KDQoNCg0KNDQ2NDYzODQ0QHFx LmNvbQ0KDQo= ------=_001_NextPart786060302667_=---- Content-Type: text/html; charset="GB2312" Content-Transfer-Encoding: quoted-printable oh sorry,
I means just use Kafka= streams API do the aggregate and not depend on Spark 

=
=0A
446463844@qq.com
=0A 
=B7=A2=BC=FE=C8=CB=A3=BA =B9=F9=C5=F4=B7=C9
=B7=A2=CB=CD=CA=B1=BC=E4=A3=BA 2018-01-30 23:06<= /div>
=CA=D5=BC=FE=C8=CB=A3=BA 446463844@qq.com
=B3=AD=CB=CD=A3=BA user
=D6=F7=CC=E2= =A3=BA Re: use kafka streams API aggregate ?

hi,
Today I do it too.


check your kafka version, then follow  one of the guide= s below.


http://spark.apache.or= g/docs/latest/streaming-kafka-0-8-integration.html

http://spark= .apache.org/docs/latest/streaming-kafka-0-10-integration.html


http://spark.apache.org/docs/latest/streami= ng-kafka-integration.html







=D4=DA 2018= =C4=EA1=D4=C230=C8=D5=A3=AC=CF=C2=CE=E710:48=A3=AC446463844@qq.com =D0=B4=B5=C0=A3=BA

= Hi
I am new= to kafka.
today I use kafka stream= s API for real timing process data
= and I have no idea with this
Can so= meone help me ?

446463844@qq.co= m

=0A ------=_001_NextPart786060302667_=------