Return-Path: X-Original-To: apmail-bigtop-user-archive@www.apache.org Delivered-To: apmail-bigtop-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5EABC18B58 for ; Tue, 9 Jun 2015 18:56:24 +0000 (UTC) Received: (qmail 72782 invoked by uid 500); 9 Jun 2015 18:56:24 -0000 Delivered-To: apmail-bigtop-user-archive@bigtop.apache.org Received: (qmail 72714 invoked by uid 500); 9 Jun 2015 18:56:24 -0000 Mailing-List: contact user-help@bigtop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@bigtop.apache.org Delivered-To: mailing list user@bigtop.apache.org Received: (qmail 72704 invoked by uid 99); 9 Jun 2015 18:56:24 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Jun 2015 18:56:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id C1BCC182901 for ; Tue, 9 Jun 2015 18:56:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.1 X-Spam-Level: X-Spam-Status: No, score=-0.1 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_MSPIKE_H2=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=oflebbe.de Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 9k-c-wDHvyUL for ; Tue, 9 Jun 2015 18:56:10 +0000 (UTC) Received: from mo4-p00-ob.smtp.rzone.de (mo4-p00-ob.smtp.rzone.de [81.169.146.216]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 531DE24965 for ; Tue, 9 Jun 2015 18:56:10 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1433876163; l=2862; s=domk; d=oflebbe.de; h=To:References:Date:In-Reply-To:From:Subject:Mime-Version: Content-Type; bh=gxD4UwRDWU54M5bsC5xZEvB7U4n90Lo/oqmio6bSHtE=; b=tNwHIE6dyTcoB1l/Es3RBKE5F/pAGi3hca7D+U/L2s3DOIT0WX2TcYYp2xuP3BAec1c KTJnKEFkbBrjelufX4vgSjcGjvT9eZY9NWkbUkMS0YeWw0sfv1H0jbc4QJqKqvy/ZspIU wQ5xWePsCfBWVyEXFZedakKAFmjGgwPlP4Q= X-RZG-AUTH: :I2okekakfv3mKNs8YSFayssaVhun1ymf7dIAgvJ0DO4rO5Ia1DW8gjE94eWm X-RZG-CLASS-ID: mo00 Received: from macky.fritz.box (p4FCCE96B.dip0.t-ipconnect.de [79.204.233.107]) by smtp.strato.de (RZmta 37.6 DYNA|AUTH) with ESMTPSA id d040d3r59Iu3fGU (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (curve secp521r1 with 521 ECDH bits, eq. 15360 bits RSA)) (Client did not present a certificate) for ; Tue, 9 Jun 2015 20:56:03 +0200 (CEST) Content-Type: multipart/signed; boundary="Apple-Mail=_1FB0C900-0FAC-4B1C-AED9-8C03273C5562"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2098\)) Subject: Re: Bundling Snappy with Hadoop X-Pgp-Agent: GPGMail 2.5b6 From: Olaf Flebbe In-Reply-To: Date: Tue, 9 Jun 2015 20:56:02 +0200 Message-Id: References: To: user@bigtop.apache.org X-Mailer: Apple Mail (2.2098) --Apple-Mail=_1FB0C900-0FAC-4B1C-AED9-8C03273C5562 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi Evans, Just discovered that snappy-devel is missing from bigtop_toolchain. Will = open a JIRA for it. Olaf > Am 09.06.2015 um 05:13 schrieb Evans Ye : >=20 > Yup, you need snappy-devel to be installed. Our new distribution = targeting bigtop 1.0 is building hadoop with snappy, so the snappy = compression should work at your side as well. :) >=20 > 2015-06-09 6:57 GMT+08:00 Kelly, Jonathan : > Nvm, answered my own question. Apparently I want snappy-devel rather = than snappy. >=20 > ~ Jonathan Kelly >=20 > From: , Jonathan Kelly > Date: Monday, June 8, 2015 at 3:31 PM > To: "user@bigtop.apache.org" > Subject: Bundling Snappy with Hadoop >=20 > Is anybody bundling Hadoop with Snappy support on Bigtop? I noticed = that = https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/ha= doop/do-component-build checks for the presence of /usr/lib/libsnappy.so = or /usr/lib64/libsnappy.so and sets $BUNDLE_SNAPPY accordingly, so it = seems that I should just need to install the snappy package, and Hadoop = will automatically be built with Snappy support. However, when I install = the snappy package ("sudo yum install -y snappy" on AmazonLinux = 2015.03), the library file that gets installed is = /usr/lib64/libsnappy.so, not /usr/lib64/libsnappy.so.1, so installing = the snappy package has no effect on the Hadoop build. >=20 > Thanks, > Jonathan Kelly >=20 --Apple-Mail=_1FB0C900-0FAC-4B1C-AED9-8C03273C5562 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQIcBAEBCgAGBQJVdzbCAAoJEN8ZruxzCgmHQ80QAMGxjlPfX5z9LFMnewnk7UjM jh8TpimAZI3yx0reG6KdUTiYYySWS1YSZbSb2xceTJWhmxRx0L93dzKvR3/1XXL4 tiLvwyiuveCqczshnq55yn8I6xVjHes1QH+8JQdUzWaApN1qIM828j4itpw475q+ KqqGer7fH5k6wFfi6ptQzsIub7alWv2M4aIkiGXoFwUq1H7fwp3qE0/rxzNbSqqL JbfO0hu/IGaXYiw17fGtCD/qk5h7h5YD58P4zQQgywmCYfWTFiQNnPhG1Xs/l9bN xRPe9Ho6GgPYcZRmagHANg21oOqN+CQTMn/spi6zHowcorrcq0RTReb3BotuYcAH Q9IjxBuGV2qyO4SjrB/MbZxvdjh4k47z2Cg3Vk/wdR+kKx3aG9D9YGCX+IS0cO3C KEk4pvFGduRoF1qdpEcnN3oMHh0aeQOG9ErfnhqWBbYDje/wUs5hedfUbeRZe57U xzeURp8MMNrQA+r7gb98n9igAtbAZBhOIZ/CfqZIZTDIJtfNmOJCJgFdBqpBgWpb 8vNEf1lEQr82+HGbsINIqV+BW93hmlqDnrZO2YystBsKbQABwHy7xqot4Bs3+TTD DTuWeIQG+sMj7HajbVMNkHBLmgZTjV2UxRyIGH4B+Mn0dW0lN4HAdDo4LClIaSn1 IaboqN4Z9Nc3ty8DNleI =9uqa -----END PGP SIGNATURE----- --Apple-Mail=_1FB0C900-0FAC-4B1C-AED9-8C03273C5562--