Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 58421C817 for ; Mon, 10 Mar 2014 15:05:42 +0000 (UTC) Received: (qmail 93918 invoked by uid 500); 10 Mar 2014 15:04:51 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 93830 invoked by uid 500); 10 Mar 2014 15:04:50 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 93823 invoked by uid 99); 10 Mar 2014 15:04:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Mar 2014 15:04:49 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [217.70.183.195] (HELO relay3-d.mail.gandi.net) (217.70.183.195) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Mar 2014 15:04:44 +0000 Received: from mfilter31-d.gandi.net (mfilter31-d.gandi.net [217.70.178.162]) by relay3-d.mail.gandi.net (Postfix) with ESMTP id 4A41CA80DC for ; Mon, 10 Mar 2014 16:04:23 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at mfilter31-d.gandi.net Received: from relay3-d.mail.gandi.net ([217.70.183.195]) by mfilter31-d.gandi.net (mfilter31-d.gandi.net [10.0.15.180]) (amavisd-new, port 10024) with ESMTP id 01mT7TCSN23W for ; Mon, 10 Mar 2014 16:04:21 +0100 (CET) X-Originating-IP: 10.58.1.143 Received: from webmail.eu.com (unknown [10.58.1.143]) (Authenticated sender: jb@nanthrax.net) by relay3-d.mail.gandi.net (Postfix) with ESMTPA id CD484A80D1 for ; Mon, 10 Mar 2014 16:04:21 +0100 (CET) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Date: Mon, 10 Mar 2014 16:04:21 +0100 From: jb@nanthrax.net To: user@hadoop.apache.org Subject: Re: Hadoop Client on OSGi In-Reply-To: References: Message-ID: <1b8e8033124368a9e1ee8978a2fc4d7b@nanthrax.net> X-Sender: jb@nanthrax.net User-Agent: Roundcube Webmail/0.9.5 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org You can take a look on the SMX bundle that I did: http://svn.apache.org/repos/asf/servicemix/smx4/bundles/trunk/hadoop-clie= nt-2.3.0/pom.xml You will see the "bundle embedded" dependencies, or the import package=20 to other bundles. Regards JB On 2014-03-10 16:00, Geoffry Roberts wrote: > JB, >=20 > Thanks, I'll look forward to your push. =C2=A0 >=20 > Something I've noticed, is the hadoop client has any number > dependencies that are already osgi-ified. =C2=A0Some of these would be > useful to have deployed apart from hadoop so they can be used by other > bundles. =C2=A0It seems a shame to have them deployed twice. =C2=A0e.g.= the > jersey.* bundles, the common.* bundles, the jackson.*, etc. =C2=A0I > haven't tried but will things work if some dependencies are osgi and > other are not? =C2=A0It seems it should. =C2=A0I'm leery of having the > hadoop.* wrapped as a bundle and the dependencies not. >=20 > Thanks >=20 > On Mon, Mar 10, 2014 at 10:38 AM, wrote: >=20 >> Hi Geoffry, >>=20 >> FYI, I just released a ServiceMix Bundles for hadoop-client 2.3.0 >> (I closed the SMX bundles release vote this morning, the artifact >> will be on Central today). >>=20 >> On the other hand, I have a branch for Hadoop 2.3.0 (it's fork on >> my machine, I will push on my github later today). >>=20 >> Some months ago, I sent some e-mail to propose Hadoop in OSGi, >> submitting some e-mails. I also created Jira with patches attached, >> but I didn't get a lot of feedback. That's why I forked local >> branches. >>=20 >> If you want, I can push my 2.3.0 branch on github and give you >> permissions on it. >> We can prepare a patch that we can attach to existing Jira. >>=20 >> Regards >> JB >>=20 >> On 2014-03-10 14:37, Geoffry Roberts wrote: >>=20 >>> All, >>>=20 >>> I would like to gauge the what the level of interest might be in >>> having a version of the Hadoop client running as an OSGi bundle. >>> =C2=A0I >>> for one would like to use such a thing. =C2=A0There have been >>> inquiries as >>> to putting the whole Hadoop shooting match in OSGi. =C2=A0I'm talking >>> here >>> about just the client. >>>=20 >>> Some one has done what I'm talking about. You can check >>> out=C2=A0Jean-Baptiste Onofre Blog [1].=C2=A0But said effort was done= for >>>=20 >>> Hadoop 3.0 and I need something for 2.3.0, =C2=A0Nevertheless, I was >>> able >>> to draw inspiration from JB's good effort. =C2=A0My need is >>> sufficiently >>> great that I could be persuaded to take the task on. =C2=A0 >>>=20 >>> What is the level of interest? =C2=A0Does anyone else share my need? >>> -- >>>=20 >>> There are ways and there are ways,=C2=A0 >>>=20 >>> Geoffry Roberts >>>=20 >>> Links: >>> ------ >>> [1] >>>=20 >>=20 > http://blog.nanthrax.net/2013/07/apache-hadoop-and-karaf-article-1-kara= f-as-hdfs-client/ >>> [1] >=20 > -- >=20 > There are ways and there are ways,=C2=A0 >=20 > Geoffry Roberts >=20 >=20 > Links: > ------ > [1] > http://blog.nanthrax.net/2013/07/apache-hadoop-and-karaf-article-1-kara= f-as-hdfs-client/