hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-18719) optimize size of shaded artifacts
Date Wed, 30 Aug 2017 20:40:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16147993#comment-16147993
] 

Sean Busbey edited comment on HBASE-18719 at 8/30/17 8:39 PM:
--------------------------------------------------------------

current sizes:
{code}
$ ls -lh `find ~/.m2/repository/org/apache/hbase/ \( -path '**/hbase-shaded-client*' -o -path
'**/hbase-shaded-server*' \) -name '*.jar' | grep -v 'SNAPSHOT' | grep -v 'project' `
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.1.10/hbase-shaded-client-1.1.10.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.1.11/hbase-shaded-client-1.1.11.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.1.12/hbase-shaded-client-1.1.12.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.2.4/hbase-shaded-client-1.2.4.jar
-rw-r--r--  1 busbey  staff    29M May 17 14:29 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.2.5/hbase-shaded-client-1.2.5.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.2.6/hbase-shaded-client-1.2.6.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.3.0/hbase-shaded-client-1.3.0.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 13:37 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.3.1/hbase-shaded-client-1.3.1.jar
-rw-r--r--  1 busbey  staff    43M Aug 30 13:38 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/2.0.0-alpha-1/hbase-shaded-client-2.0.0-alpha-1.jar
-rw-r--r--  1 busbey  staff    48M Aug 30 13:19 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/2.0.0-alpha2/hbase-shaded-client-2.0.0-alpha2.jar
-rw-r--r--  1 busbey  staff    51M Aug 30 13:29 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.1.10/hbase-shaded-server-1.1.10.jar
-rw-r--r--  1 busbey  staff    51M Aug 30 13:29 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.1.11/hbase-shaded-server-1.1.11.jar
-rw-r--r--  1 busbey  staff    51M Aug 30 13:29 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.1.12/hbase-shaded-server-1.1.12.jar
-rw-r--r--  1 busbey  staff    50M Aug 30 13:29 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.2.4/hbase-shaded-server-1.2.4.jar
-rw-r--r--  1 busbey  staff    50M Aug 30 13:30 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.2.5/hbase-shaded-server-1.2.5.jar
-rw-r--r--  1 busbey  staff    50M Aug 30 13:30 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.2.6/hbase-shaded-server-1.2.6.jar
-rw-r--r--  1 busbey  staff    50M Aug 30 13:30 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.3.0/hbase-shaded-server-1.3.0.jar
-rw-r--r--  1 busbey  staff    50M Aug 30 13:36 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.3.1/hbase-shaded-server-1.3.1.jar
-rw-r--r--  1 busbey  staff    69M Aug 30 13:36 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/2.0.0-alpha-1/hbase-shaded-server-2.0.0-alpha-1.jar
-rw-r--r--  1 busbey  staff    74M Aug 30 13:28 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/2.0.0-alpha2/hbase-shaded-server-2.0.0-alpha2.jar
{code}



was (Author: busbey):
current sizes:
{code}
$ ls -lh `find ~/.m2/repository/org/apache/hbase/ \( -path '**/hbase-shaded-client*' -o -path
'**/hbase-shaded-server*' \) -name '*.jar' | grep -v 'SNAPSHOT' | grep -v 'project' `
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.1.10/hbase-shaded-client-1.1.10.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.1.11/hbase-shaded-client-1.1.11.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.1.12/hbase-shaded-client-1.1.12.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.2.4/hbase-shaded-client-1.2.4.jar
-rw-r--r--  1 busbey  staff    29M May 17 14:29 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.2.5/hbase-shaded-client-1.2.5.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.2.6/hbase-shaded-client-1.2.6.jar
-rw-r--r--  1 busbey  staff    29M Aug 30 11:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.3.0/hbase-shaded-client-1.3.0.jar
-rw-r--r--  1 busbey  staff    29K Jun 30 09:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/1.3.1/hbase-shaded-client-1.3.1.jar
-rw-r--r--  1 busbey  staff    25K Jun 30 07:54 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/2.0.0-alpha-1/hbase-shaded-client-2.0.0-alpha-1.jar
-rw-r--r--  1 busbey  staff    48M Aug 30 13:19 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-client/2.0.0-alpha2/hbase-shaded-client-2.0.0-alpha2.jar
-rw-r--r--  1 busbey  staff    39K Jun 30 09:40 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/1.3.1/hbase-shaded-server-1.3.1.jar
-rw-r--r--  1 busbey  staff    41K Jun 30 07:54 /Users/busbey/.m2/repository/org/apache/hbase//hbase-shaded-server/2.0.0-alpha-1/hbase-shaded-server-2.0.0-alpha-1.jar
{code}


> optimize size of shaded artifacts
> ---------------------------------
>
>                 Key: HBASE-18719
>                 URL: https://issues.apache.org/jira/browse/HBASE-18719
>             Project: HBase
>          Issue Type: Improvement
>          Components: shading
>    Affects Versions: 1.3.1, 1.2.6, 2.0.0-alpha-2, 1.1.12
>            Reporter: Sean Busbey
>            Priority: Minor
>
> our shaded artifacts are pretty big, we should be able to trim them down.
> # generate a class that references all of the IA.Public classes in the hbase dependencies
for that particular shaded artifact
> # use the maven-shading-plugin's "minimize jar" option to filter everything that isn't
reachable from there
> # might need to do some clean up for indirectly used things in hadoop



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message