Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1B33F10D7C for ; Tue, 23 Jul 2013 18:00:54 +0000 (UTC) Received: (qmail 69645 invoked by uid 500); 23 Jul 2013 18:00:53 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 69577 invoked by uid 500); 23 Jul 2013 18:00:53 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 69348 invoked by uid 99); 23 Jul 2013 18:00:52 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Jul 2013 18:00:52 +0000 Date: Tue, 23 Jul 2013 18:00:52 +0000 (UTC) From: "Nick Dimiduk (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-8438) Extend bin/hbase to print a "minimal classpath" for used by other tools MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13716663#comment-13716663 ] Nick Dimiduk commented on HBASE-8438: ------------------------------------- As commented on HIVE-2055, the YARN folk have solved a related problem. They have a similar difficulty in line lengths when establishing runtime environments on Windows. Their solution is in YARN-316 and the method {{FileUtil#createJarWithClassPath()}}. The caller provides a {{PATH}} string and this method creates a temporary jar on the local fs, containing manifest classpath entries for all of the entries in the PATH-like argument. Variables and wild-cards are expanded. The method returns a String which is the path to this local jar. Perhaps we can use this to solve the classpath woes for our friends? I like it because it doesn't keep us in the business of custom classpath parsing and set manipulations on strings passed from shell scripts. > Extend bin/hbase to print a "minimal classpath" for used by other tools > ----------------------------------------------------------------------- > > Key: HBASE-8438 > URL: https://issues.apache.org/jira/browse/HBASE-8438 > Project: HBase > Issue Type: Improvement > Components: scripts > Affects Versions: 0.94.6.1, 0.95.0 > Reporter: Nick Dimiduk > Assignee: Nick Dimiduk > Attachments: 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch, 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch, 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch > > > For tools like pig and hive, blindly appending the full output of `bin/hbase classpath` to their own CLASSPATH is excessive. They already build CLASSPATH entries for hadoop. All they need from us is the delta entries, the dependencies we require w/o hadoop and all of it's transitive deps. This is also a kindness for Windows, where there's a shorter limit on the length of commandline arguments. > See also HIVE-2055 for additional discussion. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira