Return-Path: X-Original-To: apmail-uima-user-archive@www.apache.org Delivered-To: apmail-uima-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7488EF0FA for ; Thu, 13 Nov 2014 18:13:51 +0000 (UTC) Received: (qmail 9746 invoked by uid 500); 13 Nov 2014 18:13:50 -0000 Delivered-To: apmail-uima-user-archive@uima.apache.org Received: (qmail 9702 invoked by uid 500); 13 Nov 2014 18:13:50 -0000 Mailing-List: contact user-help@uima.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@uima.apache.org Delivered-To: mailing list user@uima.apache.org Received: (qmail 9690 invoked by uid 99); 13 Nov 2014 18:13:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Nov 2014 18:13:50 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of eaepstein@gmail.com designates 209.85.220.196 as permitted sender) Received: from [209.85.220.196] (HELO mail-vc0-f196.google.com) (209.85.220.196) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Nov 2014 18:13:24 +0000 Received: by mail-vc0-f196.google.com with SMTP id im17so579863vcb.7 for ; Thu, 13 Nov 2014 10:12:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=aCTUjNSC2eMlz9mcwSbuH21NtwIGTa3MG6GtfOIA6Ok=; b=kPFI0GArSC6iSiZAvjTQWYafWt1FZlS5dxoG0spL3xtkhBYMZTOlbXwin1wQsezj4Q lCf14JVD1GNaGvzsdDo+vXzyQoDAxamH7VBFKozch3OseQRY/a5+v0tt6yrtcvJzQ5vD Q4YpFOEUncXBVy/4CRwQa8jp2kPrEknGFU0FDgvt2jvsjPhbrYF87/0zH51EMi7H+DxB l3jaMWULC90jUUFmUYB+c1BVr/4mUOGJCZHpuLnpLAzz7BNsF/N47bUhij0PgatE6CUa /jnTVO4YmsJrvTA0PMMkypTTAitAs2XuE65t17LBFki7n90jjeWifwnkAZB5RxMWW/Rr d9qQ== MIME-Version: 1.0 X-Received: by 10.52.33.238 with SMTP id u14mr2540659vdi.34.1415902358478; Thu, 13 Nov 2014 10:12:38 -0800 (PST) Received: by 10.52.240.106 with HTTP; Thu, 13 Nov 2014 10:12:38 -0800 (PST) In-Reply-To: References: Date: Thu, 13 Nov 2014 13:12:38 -0500 Message-ID: Subject: Re: DUCC stuck at WaitingForResources on an Amazon Linux From: Eddie Epstein To: user@uima.apache.org Content-Type: multipart/alternative; boundary=20cf30780d061d24330507c1751e X-Virus-Checked: Checked by ClamAV on apache.org --20cf30780d061d24330507c1751e Content-Type: text/plain; charset=UTF-8 Simon, The DUCC resource manager logs into rm.log. Did you look there for reasons the resources are not being allocated? Eddie On Wed, Nov 12, 2014 at 4:07 PM, Simon Hafner wrote: > 4 shares total, 2 in use. > > 2014-11-12 5:06 GMT-06:00 Lou DeGenaro : > > Try looking at your DUCC's web server. On the System -> Machines page > > do you see any shares not inuse? > > > > Lou. > > > > On Wed, Nov 12, 2014 at 5:51 AM, Simon Hafner > wrote: > >> I've set up DUCC according to > >> https://cwiki.apache.org/confluence/display/UIMA/DUCC > >> > >> ducc_install/bin/ducc_submit -f ducc_install/examples/simple/1.job > >> > >> the job is stuck at WaitingForResources. > >> > >> 12 Nov 2014 10:37:30,175 INFO Agent.LinuxNodeMetricsProcessor - > >> process N/A ... Agent Collecting User Processes > >> 12 Nov 2014 10:37:30,176 INFO Agent.NodeAgent - > >> copyAllUserReservations N/A +++++++++++ Copying User Reservations > >> - List Size:0 > >> 12 Nov 2014 10:37:30,176 INFO Agent.LinuxNodeMetricsProcessor - call > >> N/A ********** User Process Map Size After > >> copyAllUserReservations:0 > >> 12 Nov 2014 10:37:30,176 INFO Agent.LinuxNodeMetricsProcessor - call > >> N/A ********** User Process Map Size After > >> copyAllUserRougeProcesses:0 > >> 12 Nov 2014 10:37:30,182 INFO Agent.LinuxNodeMetricsProcessor - call > N/A > >> 12 Nov 2014 10:37:30,182 INFO Agent.LinuxNodeMetricsProcessor - call > >> N/A > ****************************************************************************** > >> 12 Nov 2014 10:37:30,182 INFO Agent.LinuxNodeMetricsProcessor - > >> process N/A ... Agent ip-172-31-7-237.us-west-2.compute.internal > >> Posting Memory:4050676 Memory Free:4013752 Swap Total:0 Swap Free:0 > >> Low Swap Threshold Defined in ducc.properties:0 > >> 12 Nov 2014 10:37:33,303 INFO Agent.AgentEventListener - > >> reportIncomingStateForThisNode N/A Received OR Sequence:699 Thread > >> ID:13 > >> 12 Nov 2014 10:37:33,303 INFO Agent.AgentEventListener - > >> reportIncomingStateForThisNode N/A > >> JD--> JobId:6 ProcessId:0 PID:8168 Status:Running Resource > >> State:Allocated isDeallocated:false > >> 12 Nov 2014 10:37:33,303 INFO Agent.NodeAgent - setReservations > >> N/A +++++++++++ Copied User Reservations - List Size:0 > >> 12 Nov 2014 10:37:33,405 INFO > >> Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b - getSwapUsage- > >> N/A PID:8168 Swap Usage:0 > >> 12 Nov 2014 10:37:33,913 INFO > >> Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b - > >> collectProcessCurrentCPU N/A 0.0 == CPUTIME:0.0 > >> 12 Nov 2014 10:37:33,913 INFO > >> Agent.AgentConfiguration$$EnhancerByCGLIB$$cc49880b - process N/A > >> ----------- PID:8168 Major Faults:0 Process Swap Usage:0 Max Swap > >> Usage Allowed:-108574720 Time to Collect Swap Usage:0 > >> > >> I'm using a t2.medium instance (2 CPU, ~ 4GB RAM) and the stock Amazon > >> Linux (looks centos based). > >> > >> To install maven (not in the repos) > >> > >> #! /bin/bash > >> > >> TEMPORARY_DIRECTORY="$(mktemp -d)" > >> DOWNLOAD_TO="$TEMPORARY_DIRECTORY/maven.tgz" > >> > >> echo 'Downloading Maven to: ' "$DOWNLOAD_TO" > >> > >> wget -O "$DOWNLOAD_TO" > >> > http://www.eng.lsu.edu/mirrors/apache/maven/maven-3/3.2.3/binaries/apache-maven-3.2.3-bin.tar.gz > >> > >> echo 'Extracting Maven' > >> tar xzf $DOWNLOAD_TO -C $TEMPORARY_DIRECTORY > >> rm $DOWNLOAD_TO > >> > >> echo 'Configuring Envrionment' > >> > >> mv $TEMPORARY_DIRECTORY/apache-maven-* /usr/local/maven > >> echo -e 'export M2_HOME=/usr/local/maven\nexport > >> PATH=${M2_HOME}/bin:${PATH}' > /etc/profile.d/maven.sh > >> source /etc/profile.d/maven.sh > >> > >> echo 'The maven version: ' `mvn -version` ' has been installed.' > >> echo -e '\n\n!! Note you must relogin to get mvn in your path !!' > >> echo 'Removing the temporary directory...' > >> rm -r "$TEMPORARY_DIRECTORY" > >> echo 'Your Maven Installation is Complete.' > --20cf30780d061d24330507c1751e--