hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18577) shaded client includes several non-relocated third party dependencies
Date Mon, 28 Aug 2017 20:25:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144291#comment-16144291
] 

Sean Busbey commented on HBASE-18577:
-------------------------------------

all of below presumes you've set up any named tables, and the needed jars are in the working
directory.

Test of hbase-downstreamer:

{code}
$ /usr/java/jdk1.8.0_111/bin/java -cp /etc/hbase/conf:hbase-downstreamer-api-1.y-2.0-SNAPSHOT-1.2.6_2.6.1.jar:hbase-shaded-client-1.2.7-SNAPSHOT.jar:commons-logging-1.2.jar:log4j-1.2.17.jar:slf4j-api-1.7.5.jar:htrace-core-3.2.0-incubating.jar
org.hbase.downstreamer.GetMetaContent cdh-57464-1.gce.cloudera.com:2181 2>/dev/null
{code}

Test of built in MR examples:

{code}
$ HADOOP_CLASSPATH=/etc/hbase/conf:htrace-core-3.2.0-incubating.jar  hadoop jar hbase-shaded-server-1.2.7-SNAPSHOT.jar
org.apache.hadoop.hbase.mapreduce.Driver rowcounter 'test:exampe'
$ # After updating mapreduce.job.counters.max to be > 12,000
$ HADOOP_CLASSPATH=/etc/hbase/conf:/opt/cloudera/parcels/CDH/jars/htrace-core-3.2.0-incubating.jar
hadoop jar hbase-shaded-server-1.2.7-SNAPSHOT.jar org.apache.hadoop.hbase.mapreduce.Driver
CellCounter "test:exampe" cellcounter-out :
$ HADOOP_CLASSPATH=/etc/hbase/conf:/opt/cloudera/parcels/CDH/jars/htrace-core-3.2.0-incubating.jar
hadoop jar hbase-shaded-server-1.2.7-SNAPSHOT.jar org.apache.hadoop.hbase.mapreduce.Driver
export 'test:exampe' 'export-output'
$ HADOOP_CLASSPATH=/etc/hbase/conf:/opt/cloudera/parcels/CDH/jars/htrace-core-3.2.0-incubating.jar
hadoop jar hbase-shaded-server-1.2.7-SNAPSHOT.jar org.apache.hadoop.hbase.mapreduce.Driver
import 'test:import_target' 'export-output'
$ HADOOP_CLASSPATH=/etc/hbase/conf:/opt/cloudera/parcels/CDH/jars/htrace-core-3.2.0-incubating.jar
hadoop jar hbase-shaded-server-1.2.7-SNAPSHOT.jar org.apache.hadoop.hbase.mapreduce.Driver
rowcounter 'test:import_target'
$  HADOOP_CLASSPATH=/etc/hbase/conf:/opt/cloudera/parcels/CDH/jars/htrace-core-3.2.0-incubating.jar
hadoop jar hbase-shaded-server-1.2.7-SNAPSHOT.jar org.apache.hadoop.hbase.mapreduce.HashTable
'test:exampe' 'hashtable-out'
$ HADOOP_CLASSPATH=/etc/hbase/conf:/opt/cloudera/parcels/CDH/jars/htrace-core-3.2.0-incubating.jar
hadoop jar hbase-shaded-server-1.2.7-SNAPSHOT.jar org.apache.hadoop.hbase.mapreduce.SyncTable
'hashtable-out' 'test:exampe' 'test:import_target'
{code}

All of the above gave expected results.

I think this all works. I'll update the log4j as non-optional for master/branch-2 and post
here shortly

> shaded client includes several non-relocated third party dependencies
> ---------------------------------------------------------------------
>
>                 Key: HBASE-18577
>                 URL: https://issues.apache.org/jira/browse/HBASE-18577
>             Project: HBase
>          Issue Type: Bug
>          Components: Client
>    Affects Versions: 1.2.0, 1.1.2, 1.3.0, 2.0.0-alpha-1
>            Reporter: Sean Busbey
>            Assignee: Sean Busbey
>            Priority: Critical
>             Fix For: 3.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 2.0.0-alpha-3, 1.1.13
>
>         Attachments: HBASE-18577.WIP.0.patch, HBASE-18577.WIP.-1.patch, HBASE-18577.WIP.1.patch,
HBASE-18577.WIP.2.patch, HBASE-18577.WIP.3.patch, HBASE-18577.WIP.4.patch, HBASE-18577.WIP.5.patch,
HBASE-18577.WIP-branch-1.2.v5.patch
>
>
> we have some unexpected unrelocated third party dependencies in our shaded artifacts.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message