From user-return-6862-apmail-uima-user-archive=uima.apache.org@uima.apache.org Wed Dec 9 20:23:46 2015 Return-Path: X-Original-To: apmail-uima-user-archive@www.apache.org Delivered-To: apmail-uima-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9D33318B8C for ; Wed, 9 Dec 2015 20:23:46 +0000 (UTC) Received: (qmail 15562 invoked by uid 500); 9 Dec 2015 20:23:46 -0000 Delivered-To: apmail-uima-user-archive@uima.apache.org Received: (qmail 15512 invoked by uid 500); 9 Dec 2015 20:23:46 -0000 Mailing-List: contact user-help@uima.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@uima.apache.org Delivered-To: mailing list user@uima.apache.org Received: (qmail 15492 invoked by uid 99); 9 Dec 2015 20:23:45 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Dec 2015 20:23:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 49BFF180A77 for ; Wed, 9 Dec 2015 20:23:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.9 X-Spam-Level: ** X-Spam-Status: No, score=2.9 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id b9css-pjGCFR for ; Wed, 9 Dec 2015 20:23:30 +0000 (UTC) Received: from mail-ig0-f170.google.com (mail-ig0-f170.google.com [209.85.213.170]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id AB72724C66 for ; Wed, 9 Dec 2015 20:23:29 +0000 (UTC) Received: by mail-ig0-f170.google.com with SMTP id mv3so1218040igc.0 for ; Wed, 09 Dec 2015 12:23:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=KeLC+AMy26WaYcwC4Cv1qYZ4PRWGhgYuL952jWce7do=; b=OGIWcmOzl2nZsQuckGnar4ChZyZpNR+jyqJqgeH+/AiPxW1PXKiuaETKCXRWjm04w1 xs935G2I9+HxuAvxwXEGZxWc3fEgRkJ0LM6/aIubZinDoJv3H7Bauo6LJ0HuF+k5wm4l jru1smifs3FOVkmN0okSOgDDl33niiqcbYOrRx8/Eam55Bhy3u74yx050FJH9MR0BS0F RMWOzjfX4ibal5KjUEqdvPVrlsrGu5SYPikeVx3TW3eek67QPcIJWPabfipjj/FXio6n vAaOYejInTsEt85R/3jsU95jEWEoHcz3lzDdhSA0WfH+b2dw0IsX3GZFRXR5qt77IyRz /qfw== MIME-Version: 1.0 X-Received: by 10.50.8.2 with SMTP id n2mr27792161iga.50.1449692608543; Wed, 09 Dec 2015 12:23:28 -0800 (PST) Received: by 10.64.216.67 with HTTP; Wed, 9 Dec 2015 12:23:28 -0800 (PST) Date: Wed, 9 Dec 2015 15:23:28 -0500 Message-ID: Subject: Running native code in a heterogeneous DUCC cluster From: Burn Lewis To: user@uima.apache.org Content-Type: multipart/alternative; boundary=089e013d0dccf7456f05267cdc0c --089e013d0dccf7456f05267cdc0c Content-Type: text/plain; charset=UTF-8 Since native code requires entries in java.library.path and LD_LIBRARY_PATH that reference platform-specific libraries, it is currently impossible to scale out a job to machines with different architectures, i.e. big- & little-endian. We are considering adding support for a special variable that will be replaced at run-time with the value of the Java system property "os.arch". In this way the location of the native code could be in architecture-specific directories which would be specified in the job specification using this new variable. The variable would be replaced in the parts of the job specification that cannot be modified once the JVM has started, e.g. environment, JVM options, and classpath. The name could be DUCC_OS_ARCH but the syntax has to differ from the ${name} syntax used in the DUCC CLI options since its evaluation must be delayed until the scaled-out process is launched. Some choices are: $[DUCC_OS_ARCH] [DUCC_OS_ARCH] #DUCC_OS_ARCH# --089e013d0dccf7456f05267cdc0c--