incubator-bigtop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Mackrory (JIRA)" <>
Subject [jira] [Commented] (BIGTOP-674) Installing hadoop-mapreduce package uses 'hadoop' group before creation
Date Mon, 16 Jul 2012 18:30:36 GMT


Sean Mackrory commented on BIGTOP-674:

Although the package hadoop is ultimately a dependency, the group hadoop is assumed to have
been created in the preinst stage of the package hadoop-mapreduce. Debian Policy Manual states
"Only essential packages and pre-dependencies (Pre-Depends) may be assumed to be available."
As you'll see in the output I've copied below, dpkg does indeed list hadoop-yarn as a dependency
(which subsequently lists hadoop as a dependency), but it does so only after the error is
encountered, so it's confusing to a user at best. I've had this problem when using an aptitude
repository as well (albeit not as consistently), which I think is even worse. Perhaps a more
correct solution would be to add "Pre-Depends: hadoop (= ${source:Version})" to the deb package

As for the rpm package, I'm not sure I can find a better solution for RPMs than what I already
submitted. Perhaps using "PreReq" instrad of "Requires", but it sounds like that difference
will not be reliable anyway:

$ sudo dpkg -i hadoop-mapreduce_2.0.0-1_all.deb 
Selecting previously unselected package hadoop-mapreduce.
(Reading database ... 51084 files and directories currently installed.)
Unpacking hadoop-mapreduce (from hadoop-mapreduce_2.0.0-1_all.deb) ...
usermod: group 'hadoop' does not exist
dpkg: dependency problems prevent configuration of hadoop-mapreduce:
 hadoop-mapreduce depends on bigtop-utils; however:
  Package bigtop-utils is not installed.
 hadoop-mapreduce depends on hadoop-yarn (= 2.0.0-1); however:
  Package hadoop-yarn is not installed.
dpkg: error processing hadoop-mapreduce (--install):
 dependency problems - leaving unconfigured
Errors were encountered while processing:

> Installing hadoop-mapreduce package uses 'hadoop' group before creation
> -----------------------------------------------------------------------
>                 Key: BIGTOP-674
>                 URL:
>             Project: Bigtop
>          Issue Type: Bug
>         Environment: Debian 12.04, probably other DEB and RPM-based distros
>            Reporter: Sean Mackrory
>         Attachments: BIGTOP-674.patch
> When installing the hadoop-mapreduce package, users and files are assigned to the 'hadoop'
group before that group has been created.
> I'm still working on verifying all the details for RPMs, but I will attached a patch
that fixes this for DEBs (and quite possibly for RPMs too). It doesn't make sense to me why
the group has not been added earlier. The hadoop group is added in the hadoop.spec file on
line 510, and in the hadoop.preinst script - and I think both of these are supposed to execute
before the lines where I've added the group in the attached patch.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message