Return-Path: X-Original-To: apmail-incubator-kafka-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-kafka-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7E8189C8F for ; Fri, 4 Nov 2011 15:51:48 +0000 (UTC) Received: (qmail 3279 invoked by uid 500); 4 Nov 2011 15:51:48 -0000 Delivered-To: apmail-incubator-kafka-dev-archive@incubator.apache.org Received: (qmail 3246 invoked by uid 500); 4 Nov 2011 15:51:48 -0000 Mailing-List: contact kafka-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: kafka-dev@incubator.apache.org Delivered-To: mailing list kafka-dev@incubator.apache.org Received: (qmail 3231 invoked by uid 99); 4 Nov 2011 15:51:48 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Nov 2011 15:51:48 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of neha.narkhede@gmail.com designates 209.85.220.175 as permitted sender) Received: from [209.85.220.175] (HELO mail-vx0-f175.google.com) (209.85.220.175) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Nov 2011 15:51:41 +0000 Received: by vcbgb30 with SMTP id gb30so607967vcb.6 for ; Fri, 04 Nov 2011 08:51:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=bwl2kvc2L2HmJkyoKboyNuEtw5yRx7/YcLxN32mqAe4=; b=CwHADIDrJgBrQKIeLKyan4UlNHjlR1DnNB9/rmW7X17qjgurivVW8ghRf5DNpGU32d 5axmoP7KBB11DZcLzDNY1FJEf3zJ3DeKz9j+7jHr5RnsipI82Ri0I3nl128AAYt5OSZE q+1pIU+afktVGkeTgkfR8kUfX8MLc8jLASsmM= MIME-Version: 1.0 Received: by 10.52.88.51 with SMTP id bd19mr15431549vdb.20.1320421880717; Fri, 04 Nov 2011 08:51:20 -0700 (PDT) Received: by 10.220.148.130 with HTTP; Fri, 4 Nov 2011 08:51:20 -0700 (PDT) In-Reply-To: <89EE0528-08D8-4136-B4F6-42F4143E32FC@toolazydogs.com> References:

<4EA67F70-4B29-421B-B3B6-6E5C2B82FE89@toolazydogs.com> <4EB3F6DA.5080703@gmail.com> <4EB401F1.3020906@gmail.com> <89EE0528-08D8-4136-B4F6-42F4143E32FC@toolazydogs.com> Date: Fri, 4 Nov 2011 08:51:20 -0700 Message-ID: Subject: Re: [VOTE] Release Kafka 0.7.0-incubating (candidate 5) From: Neha Narkhede To: kafka-dev@incubator.apache.org Cc: kafka-users@incubator.apache.org Content-Type: multipart/alternative; boundary=20cf307f364a2762d904b0eaad3b X-Virus-Checked: Checked by ClamAV on apache.org --20cf307f364a2762d904b0eaad3b Content-Type: text/plain; charset=ISO-8859-1 Let me state why we included *all* the dependencies in the package distribution. Initially I thought this distribution should just work out-of-the-box after the download. That includes all unit tests, all scripts in core as well as contrib. Note that the assumption was to not have the user run ./sbt udpate to download dependencies or ./sbt package to build the sub projects. Now, assuming we have the user do both, here is the set of jars we can include - ./core/lib/zkclient-20110412.jar ./lib/apache-rat-0.8-SNAPSHOT.jar ./lib/sbt-launch.jar ./contrib/hadoop-consumer/lib/avro-1.4.0.jar ./contrib/hadoop-consumer/lib/commons-logging-1.0.4.jar ./contrib/hadoop-consumer/lib/hadoop-0.20.2-core.jar ./contrib/hadoop-consumer/lib/jackson-core-asl-1.5.5.jar ./contrib/hadoop-consumer/lib/jackson-mapper-asl-1.5.5.jar ./contrib/hadoop-consumer/lib/pig-0.8.0-core.jar ./contrib/hadoop-consumer/lib/piggybank.jar ./contrib/hadoop-producer/lib/avro-1.4.0.jar ./contrib/hadoop-producer/lib/commons-logging-1.0.4.jar ./contrib/hadoop-producer/lib/hadoop-0.20.2-core.jar ./contrib/hadoop-producer/lib/jackson-core-asl-1.5.5.jar ./contrib/hadoop-producer/lib/jackson-mapper-asl-1.5.5.jar ./contrib/hadoop-producer/lib/pig-0.8.0-core.jar ./contrib/hadoop-producer/lib/piggybank.jar .* /contrib/hadoop-consumer/target/scala_2.8.0/hadoop-consumer_2.8.0-0.7.0.jar ./contrib/hadoop-producer/target/scala_2.8.0/hadoop-producer_2.8.0-0.7.0.jar ./examples/target/scala_2.8.0/kafka-java-examples-0.7.0.jar ./core/target/scala_2.8.0/kafka-0.7.0.jar* The jars in bold are Kafka jars. The question is how will the user be able to run our jars, with just the stripped set of dependent jars we package ? >> Many of the issues about distribution would automatically be solved if Maven were used. We use maven. All the jars in "lib_managed" are downloaded from Maven. The question is not whether or not to use Maven. The question is whether you have the user download dependencies build the jars themselves or not. Once that is clear, we can reduce the set of dependent jars we include. I would encourage everyone to give your inputs now, since this is important to iron out for further releases. Thanks, Neha On Fri, Nov 4, 2011 at 8:26 AM, Alan D. Cabrera wrote: > It would... > > Many of the issues about distribution would automatically be solved if Maven were used. > > I'm a Maven zealot > > On Nov 4, 2011, at 8:17 AM, Mark wrote: > >> In regards to the size of the distribution, wouldn't a mavenized build help with this? >> >> On 11/4/11 7:42 AM, Alan D. Cabrera wrote: >>> On Nov 4, 2011, at 7:29 AM, Chris Burroughs wrote: >>> >>>> On 11/03/2011 03:41 PM, Alan D. Cabrera wrote: >>>>> Zowie. Look at all these jars that I have to make sure are kosher to distribute: >>>>> >>>>> >>>>> Can someone help me? >>>>> >>>> Assuming we can cut down on the boot/test jars. All we need is a table >>>> of "jar-name,licence", correct? >>> As far as the number of jars I am only concerned with regard to the size of the distribution, 50M. That seems excessive to me and provides no real value given that the consumers of the distribution can easily build the product themselves. >>> >>> With that said, yes, it would be helpful of there was a list: >>> >>> jar name, license, URL that indicates the license for the jar >>> >>> >>> Regards, >>> Alan >>> > > --20cf307f364a2762d904b0eaad3b--