flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ankurcha <...@git.apache.org>
Subject [GitHub] flink pull request: [FLINK-1984] Integrate Flink with Apache Mesos
Date Thu, 24 Sep 2015 06:25:51 GMT
Github user ankurcha commented on the pull request:

    https://github.com/apache/flink/pull/948#issuecomment-142825340
  
    Hi @rmetzger,
    
    This completely got buried in scheduler but i think i have finally worked out the kinks.
Thanks for spending the time to try it out. 
    
    I think we are closer to having this out of the door so have a go at it and let me know
if you see something off.
    
    ```bash
    vagrant@mesos:/vagrant$ java -Dlog4j.configuration=file:/vagrant/log4j.properties -cp
*.jar org.apache.flink.mesos.scheduler.FlinkScheduler --confDir /vagrant --port 10080
    INFO  2015-09-24 06:22:04,584 [main] FlinkScheduler$: --------------------------------------------------------------------------------
    INFO  2015-09-24 06:22:04,585 [main] FlinkScheduler$:  Starting JobManager (Version: 0.10-SNAPSHOT,
Rev:bc21de2, Date:23.09.2015 @ 20:06:33 UTC)
    INFO  2015-09-24 06:22:04,585 [main] FlinkScheduler$:  Current user: vagrant
    INFO  2015-09-24 06:22:04,585 [main] FlinkScheduler$:  JVM: OpenJDK 64-Bit Server VM -
Oracle Corporation - 1.7/24.79-b02
    INFO  2015-09-24 06:22:04,585 [main] FlinkScheduler$:  Maximum heap size: 592 MiBytes
    INFO  2015-09-24 06:22:04,585 [main] FlinkScheduler$:  JAVA_HOME: (not set)
    INFO  2015-09-24 06:22:04,588 [main] FlinkScheduler$:  Hadoop version: 2.3.0
    INFO  2015-09-24 06:22:04,588 [main] FlinkScheduler$:  JVM Options:
    INFO  2015-09-24 06:22:04,588 [main] FlinkScheduler$:     -Dlog4j.configuration=file:/vagrant/log4j.properties
    INFO  2015-09-24 06:22:04,588 [main] FlinkScheduler$:  Program Arguments:
    INFO  2015-09-24 06:22:04,588 [main] FlinkScheduler$:     --confDir
    INFO  2015-09-24 06:22:04,588 [main] FlinkScheduler$:     /vagrant
    INFO  2015-09-24 06:22:04,588 [main] FlinkScheduler$:     --port
    INFO  2015-09-24 06:22:04,589 [main] FlinkScheduler$:     10080
    INFO  2015-09-24 06:22:04,589 [main] FlinkScheduler$: --------------------------------------------------------------------------------
    INFO  2015-09-24 06:22:04,595 [main] FlinkScheduler$: Maximum number of open file descriptors
is 4096
    INFO  2015-09-24 06:22:04,596 [main] FlinkScheduler$: Loading configuration from /vagrant
    DEBUG 2015-09-24 06:22:04,665 [main] FlinkScheduler$: Serving configuration via: Some(http://127.0.0.1:10080)
    INFO  2015-09-24 06:22:04,725 [Thread-3] JobManager: Starting JobManager
    INFO  2015-09-24 06:22:04,726 [Thread-3] JobManager: Starting JobManager actor system
at :6123.
    I0924 06:22:04.812088  7312 sched.cpp:157] Version: 0.22.1
    2015-09-24 06:22:04,815:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper
C client 3.4.5
    2015-09-24 06:22:04,816:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@716: Client environment:host.name=mesos
    2015-09-24 06:22:04,818:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
    2015-09-24 06:22:04,821:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@724: Client environment:os.arch=3.16.0-30-generic
    2015-09-24 06:22:04,822:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@725: Client environment:os.version=#40~14.04.1-Ubuntu
SMP Thu Jan 15 17:43:14 UTC 2015
    2015-09-24 06:22:04,824:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@733: Client environment:user.name=vagrant
    2015-09-24 06:22:04,827:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@741: Client environment:user.home=/home/vagrant
    2015-09-24 06:22:04,829:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@753: Client environment:user.dir=/vagrant
    2015-09-24 06:22:04,830:7311(0x7fcaf8bbb700):ZOO_INFO@zookeeper_init@786: Initiating client
connection, host=127.0.0.1:2181 sessionTimeout=10000 watcher=0x7fcb29b99a60 sessionId=0 sessionPasswd=<null>
context=0x1c0f350 flags=0
    2015-09-24 06:22:04,837:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1703: initiated connection
to server [127.0.0.1:2181]
    2015-09-24 06:22:04,839:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1750: session establishment
complete on server [127.0.0.1:2181], sessionId=0x14ffdcf98d00015, negotiated timeout=10000
    I0924 06:22:04.840190  7333 group.cpp:313] Group process (group(1)@127.0.1.1:36068) connected
to ZooKeeper
    I0924 06:22:04.840239  7333 group.cpp:790] Syncing group operations: queue size (joins,
cancels, datas) = (0, 0, 0)
    I0924 06:22:04.840265  7333 group.cpp:385] Trying to create path '/mesos' in ZooKeeper
    I0924 06:22:04.843736  7333 detector.cpp:138] Detected a new leader: (id='0')
    I0924 06:22:04.843868  7331 group.cpp:659] Trying to get '/mesos/info_0000000000' in ZooKeeper
    I0924 06:22:04.844832  7331 detector.cpp:452] A new leading master (UPID=master@127.0.1.1:5050)
is detected
    I0924 06:22:04.844923  7331 sched.cpp:254] New master detected at master@127.0.1.1:5050
    I0924 06:22:04.845263  7331 sched.cpp:264] No credentials provided. Attempting to register
without authentication
    I0924 06:22:04.847537  7331 sched.cpp:448] Framework registered with 20150924-052444-16842879-5050-1219-0012
    INFO  2015-09-24 06:22:04,872 [Thread-2] log: jetty-0.10-SNAPSHOT
    INFO  2015-09-24 06:22:04,948 [Thread-2] log: Started SocketConnector@127.0.0.1:10080
    Embedded server listening at
      http://127.0.0.1:10080
    Press any key to stop.
    INFO  2015-09-24 06:22:05,194 [Thread-5] FlinkScheduler$: Accepting
    INFO  2015-09-24 06:22:05,951 [flink-akka.actor.default-dispatcher-4] Slf4jLogger: Slf4jLogger
started
    INFO  2015-09-24 06:22:06,243 [flink-akka.actor.default-dispatcher-4] Remoting: Starting
remoting
    INFO  2015-09-24 06:22:06,536 [flink-akka.actor.default-dispatcher-4] Remoting: Remoting
started; listening on addresses :[akka.tcp://flink@127.0.0.1:6123]
    INFO  2015-09-24 06:22:06,549 [Thread-3] JobManager: Starting JobManager actor
    INFO  2015-09-24 06:22:06,559 [Thread-3] BlobServer: Created BLOB server storage directory
/tmp/blobStore-b226277a-1f52-47ad-b3a5-c981cc67cb02
    INFO  2015-09-24 06:22:06,560 [Thread-3] BlobServer: Started BLOB server at 0.0.0.0:50466
- max concurrent requests: 50 - max backlog: 1000
    INFO  2015-09-24 06:22:06,588 [flink-akka.actor.default-dispatcher-4] MemoryArchivist:
Started memory archivist akka://flink/user/archive
    INFO  2015-09-24 06:22:06,595 [flink-akka.actor.default-dispatcher-2] JobManager: Starting
JobManager at akka.tcp://flink@127.0.0.1:6123/user/jobmanager.
    INFO  2015-09-24 06:22:06,623 [flink-akka.actor.default-dispatcher-2] JobManager: JobManager
akka.tcp://flink@127.0.0.1:6123/user/jobmanager was granted leadership with leader session
ID None.
    INFO  2015-09-24 06:22:06,638 [Thread-3] JobManager: Starting JobManger web frontend
    INFO  2015-09-24 06:22:06,640 [Thread-3] WebInfoServer: Setting up web info server, using
web-root directory jar:file:/vagrant/flink-dist-0.10-SNAPSHOT.jar!/web-docs-infoserver.
    INFO  2015-09-24 06:22:06,650 [Thread-3] log: jetty-0.10-SNAPSHOT
    INFO  2015-09-24 06:22:06,656 [Thread-3] log: Started SelectChannelConnector@0.0.0.0:8081
    INFO  2015-09-24 06:22:06,656 [Thread-3] WebInfoServer: Started web info server for JobManager
on 0.0.0.0:8081
    INFO  2015-09-24 06:22:06,978 [Thread-27] FlinkScheduler$: statusUpdate received from
taskId: TaskManager_1 slaveId: 20150924-052444-16842879-5050-1219-S0 [TASK_RUNNING]
    DEBUG 2015-09-24 06:22:06,979 [Thread-27] FlinkScheduler$: No action to take for statusUpdate
TASK_RUNNING
    INFO  2015-09-24 06:22:10,768 [Thread-28] FlinkScheduler$: Declining offer(s) from slave
20150924-052444-16842879-5050-1219-S0 offered [cpus: 1.5 | mem : 488.0 | disk: 33044.0] required
[cpus: 0.5 | mem: 512.0 | disk: 1024.0]
    ```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message