oodt-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christian Alan Mattmann <mattm...@usc.edu>
Subject Re: Assignment2: CAS-PGE file concontenator example FAILURE
Date Mon, 03 Nov 2014 04:42:09 GMT
It worked, see the message:

INFO: Successful ingest of product:
[/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concatenator/ou
tput/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014-11-02T21
:21:03.991Z.txt]


++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Adjunct Associate Professor, Computer Science Department
University of Southern California
Los Angeles, CA 90089 USA
Email: mattmann@usc.edu
WWW: http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++




-----Original Message-----
From: Aakarsh Medleri Hire Math <medlerih@usc.edu>
Date: Sunday, November 2, 2014 at 4:36 PM
To: Chris Mattmann <mattmann@usc.edu>
Cc: Gouthami Kondakindi <kondakin@usc.edu>, Preethi Ramesh
<pramesh@usc.edu>, "dev@oodt.apache.org" <dev@oodt.apache.org>
Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE

>Sorry Professor. I had missed a tag in events.xml because of which it was
>not identifying the task.
>
> I got couple of more errors with respect to jars not being in right
>place. After fixing them the job went through.
>
>Now I can see the concatenated file in the output folder, however i dont
>get the message saying file was ingested. I get as below.
>
>Will this be a problem or am I good to go?
>
>
>---------------------------------------------
>aakarsh@aakarsh-VirtualBox:~/Desktop/csci572/oodt-07/oodt-deploy/workflow/
>bin$ ./wmgr-client --url
>http://localhost:9001 --operation --sendEvent --eventName
>fileconcatenator-pge --metaData --key RunID testNumber1
>Sending event 'fileconcatenator-pge'... SUCCESS
>aakarsh@aakarsh-VirtualBox:~/Desktop/csci572/oodt-07/oodt-deploy/workflow/
>bin$ 
>--------------------------------------------------------------------------
>-
>
>
>I checked the logs for batch_stub and I see this:
>------------------------------
>---------------------------------------------
>INFO: Successfully ingested product:
>[/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concatenator/o
>utput/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014-11-02T
>21:21:03.991Z.txt]: product id: 29919f44-62d6-11e4-8736-abf940e2f70f
>Nov 02, 2014 1:21:09 PM org.apache.oodt.cas.crawl.ProductCrawler
>handleFile
>INFO: Successful ingest of product:
>[/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concatenator/o
>utput/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014-11-02T
>21:21:03.991Z.txt]
>Nov 02, 2014 1:21:09 PM org.apache.oodt.cas.pge.PGETaskInstance
>verifyIngests
>WARNING: Product was not ingested
>[file='/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concaten
>ator/output/jobs/job-2014-11-02T21:21:03.991Z/sciPgeExeScript_FileConcaten
>ator',result='PRECONDS_FAILED',msg='Failed to pass preconditions']
>Nov 02, 2014 1:21:09 PM org.apache.oodt.cas.pge.PGETaskInstance
>verifyIngests
>WARNING: Product was not ingested
>[file='/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge/file_concaten
>ator/output/jobs/job-2014-11-02T21:21:03.991Z/concatenatedOutputFile-2014-
>11-02T21:21:03.991Z.txt.met',result='PRECONDS_FAILED',msg='Failed to pass
>preconditions']
>--------------------------------------------------------------------------
>-
>
>
>Thanks,
>Aakarsh
>
>
>
>On Sun, Nov 2, 2014 at 11:56 AM, Christian Alan Mattmann
><mattmann@usc.edu> wrote:
>
>Hmm, so it sounds like your workflow manager is running, on port 9001,
>and that you are sending an event to it via the workflow manager client,
>hopefully via http://localhost:9001, correct? If so, you should see the
>notice you received in the workflow logs, e.g., Event received for..
>
>My question is - did you copy the appropriate policy into events.xml
>from the file concatenate pge example? You need that event to be mapped
>to your specific workflow and it sounds like it isnĀ¹t.
>
>Please also include dev@oodt.apache.org on your emails. Thanks.
>
>Cheers,
>Chris
>
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>Chris Mattmann, Ph.D.
>Adjunct Associate Professor, Computer Science Department
>University of Southern California
>Los Angeles, CA 90089 USA
>Email: mattmann@usc.edu
>WWW: http://sunset.usc.edu/~mattmann/
>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
>-----Original Message-----
>From: Aakarsh Medleri Hire Math <medlerih@usc.edu>
>Date: Sunday, November 2, 2014 at 10:44 AM
>To: Chris Mattmann <mattmann@usc.edu>
>Cc: Gouthami Kondakindi <kondakin@usc.edu>, Preethi Ramesh
><pramesh@usc.edu>
>Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE
>
>>It doesnt give me any other error log.
>>
>>
>>The only log I get is in workflow as below:
>>Nov 01, 2014 5:35:46 PM
>>org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager handleEvent
>>INFO: WorkflowManager: Received event: fileconcatenator-pge
>>
>>
>>The failure doesnt say anything but sending failure like the one in the
>>snapshot i sent earlier.
>>
>>I dont say any events/workflow tasks in the console as well. It is empty.
>>
>>
>>
>>Thanks,
>>Aakarsh
>>
>>
>>On Sun, Nov 2, 2014 at 9:40 AM, Christian Alan Mattmann
>><mattmann@usc.edu> wrote:
>>
>>Hm ok workflow manager is running. That verifies that.
>>
>>Can you suggest what the failure you are getting is?
>>
>>Cheers,
>>Chris
>>
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>Chris Mattmann, Ph.D.
>>Adjunct Associate Professor, Computer Science Department
>>University of Southern California
>>Los Angeles, CA 90089 USA
>>Email: mattmann@usc.edu
>>WWW: http://sunset.usc.edu/~mattmann/
>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>
>>
>>
>>
>>-----Original Message-----
>>From: Aakarsh Medleri Hire Math <medlerih@usc.edu>
>>Date: Sunday, November 2, 2014 at 10:37 AM
>>To: Chris Mattmann <mattmann@usc.edu>
>>Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE
>>
>>>telnet localhost 9001 gives this professor:
>>>telnet localhost 9001
>>>Trying 127.0.0.1...
>>>Connected to localhost.
>>>Escape character is '^]'.
>>>Connection closed by foreign host.
>>>
>>>
>>>
>>>On Sun, Nov 2, 2014 at 8:38 AM, Christian Alan Mattmann
>>><mattmann@usc.edu> wrote:
>>>
>>>Sorry I meant telnet localhost 9001
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>Chris Mattmann, Ph.D.
>>>Adjunct Associate Professor, Computer Science Department
>>>University of Southern California
>>>Los Angeles, CA 90089 USA
>>>Email: mattmann@usc.edu
>>>WWW: http://sunset.usc.edu/~mattmann/
>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>
>>>
>>>
>>>
>>>-----Original Message-----
>>>From: Aakarsh Medleri Hire Math <medlerih@usc.edu>
>>>Date: Saturday, November 1, 2014 at 11:18 PM
>>>To: Chris Mattmann <mattmann@usc.edu>
>>>Subject: Re: Assignment2: CAS-PGE file concontenator example FAILURE
>>>
>>>>Worflow, Resource & File managers are all running professor.
>>>>
>>>>
>>>>telnet 9001 gives me this:
>>>>aakarsh@aakarsh-VirtualBox:~/Desktop/csci572/oodt-07/oodt-deploy/workfl
>>>>o
>>>>w
>>>>$
>>>> telnet 9001
>>>>Trying 0.0.35.41...
>>>>telnet: Unable to connect to remote host: Invalid argument
>>>>
>>>>
>>>>Thanks,
>>>>Aakarsh
>>>>
>>>>
>>>>
>>>>
>>>>On Sat, Nov 1, 2014 at 10:08 PM, Christian Alan Mattmann
>>>><mattmann@usc.edu> wrote:
>>>>
>>>>Can you please make sure your Workflow Manager is running?
>>>>What happens when you telnet 9001?
>>>>
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>Chris Mattmann, Ph.D.
>>>>Adjunct Associate Professor, Computer Science Department
>>>>University of Southern California
>>>>Los Angeles, CA 90089 USA
>>>>Email: mattmann@usc.edu
>>>>WWW: http://sunset.usc.edu/~mattmann/
>>>>++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>>>
>>>>
>>>>
>>>>
>>>>-----Original Message-----
>>>>From: Aakarsh Medleri Hire Math <medlerih@usc.edu>
>>>>Date: Saturday, November 1, 2014 at 6:55 PM
>>>>To: Chris Mattmann <mattmann@usc.edu>
>>>>Subject: Assignment2: CAS-PGE file concontenator example FAILURE
>>>>
>>>>>Hi Professor,
>>>>>
>>>>>
>>>>>I am trying to invoke FileConcatenatorPGE by running the wmgr-client
>>>>>and
>>>>>I get a failure as below:
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>However, there is no log on what exactly is causing the failure.
>>>>>
>>>>>I check oodt.out, worflow, file and resource manager logs. There is no
>>>>>indication of any errors.
>>>>>
>>>>>
>>>>>Resource manager batch_stub is also running on port 2001.
>>>>>
>>>>>
>>>>>I am stuck here and have exhausted all possible options I could find
>>>>>to
>>>>>resolve this.
>>>>>Could you please help me figure this out?
>>>>>
>>>>>
>>>>>Note: I am running OODT 0.7 and following environment variables are
>>>>>being
>>>>>set.
>>>>>export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-i386/
>>>>>export JCC_JDK=/usr/lib/jvm/java-7-openjdk-i386/
>>>>>export JRE_HOME=/usr/lib/jvm/java-7-openjdk-i386/jre/
>>>>>export OODT_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/
>>>>>export
>>>>>FILEMGR_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/filemgr
>>>>>export
>>>>>CRAWLER_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/crawler
>>>>>export
>>>>>WORKFLOW_HOME=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/workfl
>>>>>o
>>>>>w
>>>>>export PGE_ROOT=/home/aakarsh/Desktop/csci572/oodt-07/oodt-deploy/pge
>>>>>export WORKFLOW_URL=http://localhost:9001
>>>>>export FILEMGR_URL=http://localhost:9000
>>>>>
>>>>>
>>>>>
>>>>>Thanks,
>>>>>Aakarsh
>>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>>
>>
>>
>>
>>
>>
>>
>
>
>
>
>
>
>
>

Mime
View raw message