incubator-bigtop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roman Shaposhnik (Commented) (JIRA)" <>
Subject [jira] [Commented] (BIGTOP-398) How does bigtop deal with flume dependency on CDH?
Date Tue, 14 Feb 2012 16:37:59 GMT


Roman Shaposhnik commented on BIGTOP-398:


# Correct. To be even more explicit where Bigtop is coming from is -- building a Bigdata management
distribution/stack. To that end we have a hard goal of harmonizing all dependencies between
components in the distribution. IOW, if component A happens to be part of the distribution
all other components depending on A have to depend on exact version of A that is part of Bigtop
and nothing else (that is why we try very hard to make sure that there's a single copy of
an A artifact(s) and all other components reference it in some way). Hadoop is a good example
of a component that is part of the distribution with almost everything else depending on it
(hence we use techniques ranging from symbloic linking from lib to the actual Hadoop jars
all the way to constructing a classpath). We also have a soft goal of harmonizing dependencies
that do NOT come from the distribution itslef. IOW, if Bigtop components depend on a non-Bigtop
component foo, we would like to make sure that the version of foo is common, but we don't
really make sure that there just one copy of foo. log4j artifacts are a good example.

# At this point we draw a very hard line at ASL. If a piece of software is not covered by
ASL, currently Bigtop will not be able to incorporate it. We try to focus on ASF projects,
but if a really interesting piece of software comes along which is covered by ASL, but is
not (yet?) part of the ASF -- we might consider including it. Such was the case with Oozie,
for example.
> How does bigtop deal with flume dependency on CDH?
> --------------------------------------------------
>                 Key: BIGTOP-398
>                 URL:
>             Project: Bigtop
>          Issue Type: Bug
>            Reporter: Arun C Murthy
>            Assignee: Bruno Mahé
>              Labels: cdh
> Currently flume (part of BigTop) depends on CDH components (thrift, zk, hadoop-core).
How does Bigtop deal with this?

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message