giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roman Shaposhnik (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GIRAPH-632) YARN dependencies add a fair amount of size to the fat jar and may be subject to simplification
Date Mon, 10 Feb 2014 03:46:19 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Roman Shaposhnik updated GIRAPH-632:
------------------------------------

    Fix Version/s:     (was: 1.1.0)
                       (was: 1.0.0)

> YARN dependencies add a fair amount of size to the fat jar and may be subject to simplification
> -----------------------------------------------------------------------------------------------
>
>                 Key: GIRAPH-632
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-632
>             Project: Giraph
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 1.0.0, 1.1.0
>            Reporter: Eli Reisman
>            Priority: Minor
>
> The hadoop_yarn profile requires some new package dependencies that the rest of our build
does not. They add size to the build projects, and due to the fact that our YARN implementation
"rides the fence" between the old API (for our ApplicationMaster) and the new API (for our
Client) were "what worked for me at the time"
> on the Maven repos there are a number of "api" versions of some of these libs that are
lighter weight. Someone (maybe me someday but not yet, sorry) could experiment with just replacing
some of our current yarn reps in the Maven profile that "cast a very wide net" with a bunch
of smaller, lighter weight packages that cover the same API we need. See also Maven repos
and the YARN dependencies listed there.
> My very brief experiments with this didn't yield anything, but again I ran out of time
and barely played with this before having other responsibilities take priority. Seems like
this would not be hard to tune up and could be good for our build.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message