incubator-ambari-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paulo Ricardo Paz Vital <pvi...@linux.vnet.ibm.com>
Subject Re: Building HDP Repo RPMS
Date Fri, 14 Jun 2013 14:01:27 GMT
Robin,

You can use Bigtop [1] to create new RPM files of Hadoop (use the
release 0.3.0 that supports Hadoop-1.X) and set a local repository with
the new files to be used by Ambari.

[1]http://bigtop.apache.org/
[2]http://archive.apache.org/dist/incubator/bigtop/bigtop-0.3.0-incubating/

I've been using this approach in some tests with 1.2.X releases, but I
guess you can do the same with 0.9 - configure Ambari to use your
internal/local repository. 

Best regards, Paulo.

On Fri, 2013-06-14 at 09:29 -0400, Robin Carnow wrote:
> Thank you JP for your better articulation of my question although the
> rpms I need are different.
> 
> Yusaku I am not familiar with Bigtop.  Are you saying that there is
> some way to use Bigtop to take the hadoop-1.0.4-1.x86_64.rpm (or maybe
> hadoop-1.0.4.tar.gz) and build the following rpms:
> 
> HDP/repos/centos5/hadoop/hadoop-source-1.0.4-1.el5.x86_64.rpm
> HDP/repos/centos5/hadoop/hadoop-jobtracker-1.0.4-1.el5.x86_64.rpm
> HDP/repos/centos5/hadoop/hadoop-secondarynamenode-1.0.4-1.el5.x86_64.rpm
> HDP/repos/centos5/hadoop/hadoop-sbin-1.0.4-1.el5.x86_64.rpm
> HDP/repos/centos5/hadoop/hadoop-debuginfo-1.0.4-1.el5.x86_64.rpm
> HDP/repos/centos5/hadoop/hadoop-pipes-1.0.4-1.el5.x86_64.rpm
> HDP/repos/centos5/hadoop/hadoop-native-1.0.4-1.el5.x86_64.rpm
> HDP/repos/centos5/hadoop/hadoop-tasktracker-1.0.4-1.el5.x86_64.rpm
> 
> 
> These are the rpms I need to get a local HDP-1.1.1.16 repo up.
> 
> 
> 
> Thank you,
> Robin
> 
> 
> 
> On Fri, Jun 14, 2013 at 7:46 AM, Jp <pandian912@gmail.com> wrote:
>         The hadoop rpm in HDP repo  has the following rpms...
>         
>         hadoop-sbin-1.2.0.1.3.0.0-107.el6.x86_64
>         hadoop-lzo-0.5.0-1.x86_64
>         hadoop-lzo-native-0.5.0-1.x86_64
>         hadoop-libhdfs-1.2.0.1.3.0.0-107.el6.x86_64
>         hadoop-1.2.0.1.3.0.0-107.el6.x86_64
>         hadoop-native-1.2.0.1.3.0.0-107.el6.x86_64
>         hadoop-pipes-1.2.0.1.3.0.0-107.el6.x86_64
>         
>         whereas the hadoop rpm released by apache has only 
>         
>         hadoop-1.0.4-1.x86_64.rpm 
>         
>         Is it ok to use apache hadoop rpm instead of HDP hadoop rpm... ll ambari work
fine?
>         
>         If not how do we split the hadoop-1.0.4-1.x86_64.rpm  into different rpms as
provided by 
>         HDP....
>         
>         Is it possible to revert to manual configuration after using ambari? If so where
do we find the required conf files?
>         I dont see them in the statndard folder "/etc/hadoop"
>         
>         
>         
>         
>         On 14-Jun-13 3:23 AM, Yusaku Sako wrote:
>         
>         > AFAIK, HDP is built using Bigtop.
>         > Haven't tested but looks like there are RPMs here:
>         > https://archive.apache.org/dist/hadoop/core/hadoop-1.0.4/
>         > 
>         > Yusaku
>         > 
>         > On Thu, Jun 13, 2013 at 12:16 PM, Robin Carnow <robin@goldbot.com>
wrote:
>         > > Hello,
>         > > 
>         > > I have a question about the set of hadoop rpms that are available in
the HDP
>         > > and HDP-UTILS repos.
>         > > Does anyone know how the rpms are made?
>         > > I have a situation where I must use hadoop 1.0.4, but 1.0.3 is the
latest
>         > > version used by ambari 0.9.
>         > > 
>         > > Is there any way to get or create the same set of rpms for hadoop 1.0.4
so
>         > > that they will work with Ambari 0.9?  Maybe there is build script that
is
>         > > run?
>         > > 
>         > > I've looked through the rpms and some are just text files which I can
use.
>         > > Some have binary executables which I guess would not work with a newer
>         > > version of hadoop.
>         > > 
>         > > I know that Ambari 0.9 is VERY old and I should not be using it.  I
do not
>         > > have any choice in the matter.  I need a quick fix until I'm able to
use
>         > > 1.2.
>         > > 
>         > > Any help would be much appreciated
>         > > 
>         > > 
>         > > Thank you,
>         > > Robin
>         
>         
> 
> 



Mime
View raw message