beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (BEAM-4849) Support running Beam Samza jobs in Yarn
Date Wed, 25 Jul 2018 22:41:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-4849?focusedWorklogId=127551&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-127551
]

ASF GitHub Bot logged work on BEAM-4849:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 25/Jul/18 22:40
            Start Date: 25/Jul/18 22:40
    Worklog Time Spent: 10m 
      Work Description: lukecwik commented on issue #6029: [BEAM-4849] Support running Beam
Samza jobs in Yarn
URL: https://github.com/apache/beam/pull/6029#issuecomment-407919159
 
 
   For some reason after attempting to get the precommit to pass it has been consistently
failing on
   ```
   Task :beam-examples-java:compileTestJava FAILED
   /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/examples/java/src/test/java/org/apache/beam/examples/cookbook/BigQueryTornadoesIT.java:22:
error: cannot access BigqueryMatcher
   import org.apache.beam.sdk.io.gcp.testing.BigqueryMatcher;
                                            ^
     bad class file: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.7.0-SNAPSHOT-tests.jar(/org/apache/beam/sdk/io/gcp/testing/BigqueryMatcher.class)
       unable to access file: java.util.zip.ZipException: invalid stored block lengths
       Please remove or make sure it appears in the correct subdirectory of the classpath.
   1 error
   :beam-examples-java:compileTestJava (Thread[Task worker for ':' Thread 8,5,main]) completed.
Took 16.434 secs.
   ```
   Any ideas?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 127551)
    Time Spent: 50m  (was: 40m)

> Support running Beam Samza jobs in Yarn
> ---------------------------------------
>
>                 Key: BEAM-4849
>                 URL: https://issues.apache.org/jira/browse/BEAM-4849
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-samza
>            Reporter: Xinyu Liu
>            Assignee: Xinyu Liu
>            Priority: Major
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> We need to some util classes and script to run beam job containers in Yarn. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message