Return-Path: Delivered-To: apmail-hadoop-avro-dev-archive@minotaur.apache.org Received: (qmail 89106 invoked from network); 11 Jan 2010 22:43:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 11 Jan 2010 22:43:18 -0000 Received: (qmail 49429 invoked by uid 500); 11 Jan 2010 22:43:18 -0000 Delivered-To: apmail-hadoop-avro-dev-archive@hadoop.apache.org Received: (qmail 49350 invoked by uid 500); 11 Jan 2010 22:43:18 -0000 Mailing-List: contact avro-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: avro-dev@hadoop.apache.org Delivered-To: mailing list avro-dev@hadoop.apache.org Received: (qmail 49340 invoked by uid 99); 11 Jan 2010 22:43:18 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Jan 2010 22:43:18 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Jan 2010 22:43:15 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 84A70234C495 for ; Mon, 11 Jan 2010 14:42:54 -0800 (PST) Message-ID: <1855285747.164441263249774541.JavaMail.jira@brutus.apache.org> Date: Mon, 11 Jan 2010 22:42:54 +0000 (UTC) From: "Jeff Hammerbacher (JIRA)" To: avro-dev@hadoop.apache.org Subject: [jira] Commented: (AVRO-163) Each language Avro supports should be a separate package In-Reply-To: <694481225.1256079719457.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/AVRO-163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798902#action_12798902 ] Jeff Hammerbacher commented on AVRO-163: ---------------------------------------- I think a top-level tutorial folder is better than a per-implementation tutorial. I only bring it up now as it's a directory layout issue. Sorry for holding up this change, we can debate a tutorial later. > Each language Avro supports should be a separate package > -------------------------------------------------------- > > Key: AVRO-163 > URL: https://issues.apache.org/jira/browse/AVRO-163 > Project: Avro > Issue Type: Improvement > Components: c, c++, java, python > Environment: We currently release Avro as a single monolithic tarball with ant being used to build all the languages that Avro supports. > Reporter: Matt Massie > Assignee: Doug Cutting > Priority: Critical > Fix For: 1.3.0 > > Attachments: AVRO-163-cpp.patch, AVRO-163.patch, AVRO-163.patch, AVRO-163.patch, AVRO-163.sh > > Original Estimate: 8h > Remaining Estimate: 8h > > *Build Issue* > While ant is used for building Java projects, it is almost never used to build python, c++ or c projects. C and C++ projects are often managed using autotools while Python uses setuptools. Forcing these languages to use a foreign build system ('ant') is suboptimal and will cause us headaches as we move forward. > *Release issue* > Releasing a single monolithic package forces users of one language to download binary and source for all languages. For example, at this time the Avro C distribution is only 384K in size (built using autotools 'make distcheck' target). People interested in using the C implementation would be forced to download a large monolithic tarball (currently 3.8 MB) that includes dozens of third-party jar files for the Java implementation. Furthermore, C users would be forced to use 'ant' as the top-level build tool. This monolithic approach would also prevent us from submitting Avro for inclusion in Linux distribution yum/apt repositories as RPM and Debian packages. It's important to allow C/C++ code to have a pristine release tarball on which to base Debian and RPM packaging. > *Solution* > Create top-level directories: 'java', 'python', 'c++ ' , 'c', 'shared' and 'release'. Each language directory would contain the source for that language and use the build system natural for that language, e.g. ant, autotools, setuptools, gem, etc. The 'shared' directory would have, for example, common test schema and data files for interoperability testing between each language. A simple top-level bash script would call into each language to build a release package, documentation, etc. into the 'release' directory. Each Avro release would then be compromised of package(s) for each language Avro supports, e.g. avro-java-1.2.3.tar.gz, pyavro-1.2.3.tar.gz, avro-c++-1.2.3.tar.gz and avro-c-1.2.3.tar.gz. Later on, we'll also likely have libavro-devel-1.2.3-1.x86_64.rpm too. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.