Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2D754200C60 for ; Mon, 24 Apr 2017 19:45:07 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2C20F160B99; Mon, 24 Apr 2017 17:45:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4C6D7160B93 for ; Mon, 24 Apr 2017 19:45:06 +0200 (CEST) Received: (qmail 52363 invoked by uid 500); 24 Apr 2017 17:45:05 -0000 Mailing-List: contact dev-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@zookeeper.apache.org Delivered-To: mailing list dev@zookeeper.apache.org Received: (qmail 52348 invoked by uid 99); 24 Apr 2017 17:45:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Apr 2017 17:45:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id AB8331857B2 for ; Mon, 24 Apr 2017 17:45:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.979 X-Spam-Level: * X-Spam-Status: No, score=1.979 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id QL5S3MmwnXd2 for ; Mon, 24 Apr 2017 17:45:02 +0000 (UTC) Received: from mail-vk0-f51.google.com (mail-vk0-f51.google.com [209.85.213.51]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 72D3C5F3F0 for ; Mon, 24 Apr 2017 17:45:01 +0000 (UTC) Received: by mail-vk0-f51.google.com with SMTP id 198so21541027vkk.2 for ; Mon, 24 Apr 2017 10:45:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=dYBrJlkwJHxFpZ3LiCEHLTYp3QlV+2fPAOnlJvuNaMI=; b=ZKMnRxiBuSrvmFmWZyV9cNNFoaJBWJTNLCnCA3hqgSes8cLXr/RrN4Ua4MCR4MFnT+ gXTUmi2cugg3ukoReHQCf5kXJ98UnJf8RNLTldx7Upj1j2D7B9Ezk3e5ItZ7ecKwGOpZ J4g5fx1k62ahwlJuXRPGUdN8K1P34ZDqlvys0u7KkQ9ZyY6XDNTtbdMunrN9npE7lHhj O+IDhwHhcyKdwwrEPhZbRa+XRBH0g3aU8q80FanB4J223CBGDrT1Ozgc5n/4olVuEZwd C47fqgjn+lWUMjePG4k2xryPHHDuUycgZsi30m71t3/+IMDDE1+crhJdNJWWM0QIs/2z iMgg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=dYBrJlkwJHxFpZ3LiCEHLTYp3QlV+2fPAOnlJvuNaMI=; b=k6oU27gyC9MwSoQKqAp11O5r8Bf0dujh0JJNzSC/8yjTe75WpxKD+V9VNXYrHm8u58 Sx4vEQQYuxz9Jad2tr2eF+wGuo+kytjNzESTLZj2Apr/Kdy7+zVq8BX+Lrs0EKN1bwci CXr5/HlmROWUGWWTkjigyYLakYGDFA4yJ9GjJAr6gwmx4hB82qZqCpVGb+wTrmQkMVdE NqLc8njHcV0VEEblOpv7hrEc+XdSMxKNT9Mc+DWA7E04/U88YWn0wy92SCiGlTzcLk5a Xf910prXuJ6x7JlVZVSFteQ3GeJqO8AiwE9FXUz3DWY+wfDiU7GAyDn5J3ASQgT4bw6H pIPA== X-Gm-Message-State: AN3rC/6oMkY8eQ4tHwLUFFroUI9ElC7Q8PTWvcZPdCtZ7NfcRlvdSpo3 qDxPyY7rvRS6BxTiKyYGY2mhmxjMXG0t X-Received: by 10.31.161.214 with SMTP id k205mr3427655vke.57.1493055900106; Mon, 24 Apr 2017 10:45:00 -0700 (PDT) MIME-Version: 1.0 Received: by 10.176.65.9 with HTTP; Mon, 24 Apr 2017 10:44:29 -0700 (PDT) In-Reply-To: <1965002853.1340517.1492782512779@mail.yahoo.com> References: <1965002853.1340517.1492782512779@mail.yahoo.com> From: Michael Han Date: Mon, 24 Apr 2017 10:44:29 -0700 Message-ID: Subject: Re: What is the role of Zookeeper and its external Integration dependencies To: dev@zookeeper.apache.org Cc: UserZooKeeper , devulapalli8@gmail.com Content-Type: multipart/alternative; boundary=001a1143f1688e72ba054ded2a25 archived-at: Mon, 24 Apr 2017 17:45:07 -0000 --001a1143f1688e72ba054ded2a25 Content-Type: text/plain; charset=UTF-8 Some notes on the CVE - it's only affecting the C client shell, which is not part of the C client API. Even if some of the projects mentioned here use C client API (which afaik does not), they should not be impacted by this specific CVE from a functional point of view. On Fri, Apr 21, 2017 at 6:48 AM, Bobby Evans wrote: > Upendar, > You are asking questions about multiple projects on a mailing list only > for one of them. Your questions are also a bit confusing which is probably > why no one has answered them yet. I understand a bit about ZK, and kafka, > but I am a storm committer so hopefully I can answer some of your questions. > 1) The dependencies for ZK are called out in the pom.xml for the version > you are using. > > https://mvnrepository.com/artifact/org.apache.zookeeper/zookeeper > For 3.4.10, the version you are asking about https://mvnrepository.com/ > artifact/org.apache.zookeeper/zookeeper/3.4.10 lists several > dependencies. The client and the server are together in the same package > and there are some configuration options here too that control the usage of > some dependencies. As such I am not sure exactly which are required just > for the client and what are just for the server. I do know that jline is > just for the client and is not even a 100% requirement there. > > 2) The role of ZK in storm is to store the current state of the cluster. > In the 1.x release and above it also does leader election. For Kafka the > role is similar. It holds the state of the system, although I am not as > familiar with the internals here. > As for providing a better use case to understand I am not sure at all what > you mean. ZK is a fairly general purpose state store that is used by a lot > of different projects in different ways. If you want to see some of what > is possible look at http://curator.apache.org/ which provides higher > level APIs on top of ZK to do a lot of different useful things. > 3) This is where I am not an expert. The CVE you mentioned appears to be > for a buffer overflow in the C API. I know storm only uses the java API so > it should not be an issue for you. I am not sure about kafka, but I > suspect that it too does not use the C API. You might want to check on the > kafka mailing list though. > If you just want to upgrade to 3.4.10, you probably can on the server > side. I believe that all of the 3.4.x clients should be compatible with > all of the 3.4.x servers, but you probably want to test it out first to be > sure it all appears to be working. As for upgrading the clients that is > something you need to work with both storm and kafka to do. For storm I > am not totally sure on 0.10 if zookeeper is shaded or not. I don't think > it is so you can probably just replace the zookeeper jar in the lib > directory on all of the nodes with the new one. But I don't know for sure. > > - Bobby > > On Thursday, April 20, 2017, 9:02:51 PM CDT, upendar devu < > devulapalli8@gmail.com> wrote:Could you please respond to my query. Thanks > > On Thu, Apr 13, 2017 at 2:46 PM, upendar devu > wrote: > > > Sorry looks like I missed to share my queries to dev team > > > > We are using zookeeper 3.4.6 version with integration of Apache Kafka , > > Apache Storm and Zookeeper. > > > > I would like to understand the following things. Please help me to > clarify. > > > > 1. What are Integration dependencies of Zookeeper ? > > Since we are using Kafka, Storm , so we need Zookeeper ? which > external > > integration has dependencies > > > > 2. What is the actual role of zookeeper with the integration of Apache > > Kafka,Apache Storm. Could you please provide a better use case to > > understand. sorry asking this question, I need to understand and am aware > > of this at least now from you. > > > > 3. We are planning to upgrade Zookeeper version to 3.4.10 due to CVE ( > > CVE-2016-5017) mentioned with version 3.4.6 ; Do we also need to upgrade > > depedency integration components like Apache Storm(*using 0.10.0*) and > > Apache Kafka (Using *0.8.1.1*) ? which version those should be upgraded > > to ? > > > > On Thu, Apr 13, 2017 at 2:43 PM, upendar devu > > wrote: > > > >> Including Dev Team to address my queries > >> > >> On Thu, Apr 13, 2017 at 2:39 PM, upendar devu > >> wrote: > >> > >>> We are using zookeeper 3.4.6 version with integration of Apache Kafka , > >>> Apache Storm and Zookeeper. > >>> > >>> I would like to understand the following things. Please help me to > >>> clarify. > >>> > >>> 1. What are Integration dependencies of Zookeeper ? > >>> Since we are using Kafka, Storm , so we need Zookeeper ? which > >>> external integration has dependencies > >>> > >>> 2. What is the actual role of zookeeper with the integration of Apache > >>> Kafka,Apache Storm. Could you please provide a better use case to > >>> understand. > >>> > >>> 3. We are planning to upgrade Zookeeper version to 3.4.10 due to CVE ( > >>> CVE-2016-5017) mentioned with version 3.4.6 ; Do we also need to > >>> upgrade depedency integration components like Apache Storm(*using > >>> 0.10.0*) and Apache Kafka (Using *0.8.1.1*) ? which version those > >>> should be upgraded to ? > >>> > >>> > >>> Thanks > >>> Upendar > >>> > >> > >> > > > -- Cheers Michael. --001a1143f1688e72ba054ded2a25--