Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 775B6184DF for ; Thu, 23 Jul 2015 12:13:08 +0000 (UTC) Received: (qmail 27988 invoked by uid 500); 23 Jul 2015 12:13:03 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 27911 invoked by uid 500); 23 Jul 2015 12:13:03 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 27901 invoked by uid 99); 23 Jul 2015 12:13:03 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Jul 2015 12:13:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D714718D094 for ; Thu, 23 Jul 2015 12:13:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 5.129 X-Spam-Level: ***** X-Spam-Status: No, score=5.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, KAM_BADIPHTTP=2, KAM_LOTSOFHASH=0.25, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=googlemail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id lkDrvPEK0bg6 for ; Thu, 23 Jul 2015 12:13:00 +0000 (UTC) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id E702650614 for ; Thu, 23 Jul 2015 12:12:59 +0000 (UTC) Received: by wibxm9 with SMTP id xm9so146077512wib.1 for ; Thu, 23 Jul 2015 05:12:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=OXQGFj2Xs4W35+szRmfw61IPZ2qE3aP/0soxW5WkDJ4=; b=QiiehUyC2vqC/jQIShl1SjKBeJAPduHiIpk5xGZ74nlDIiSYy+m6FweYM+IbkRVOpF 4gal31tlcGzp8CTynYNxsyod5FVqT3PkA9lX1ciemu+533gPCZMRhJzqN7FPfPF82waV TseIo0Vwccp5wUjsXyNKv23Q8ba9UnfU02YqqtqJsf7w/d1Ru7qWCDnFmabhPbZ1mk5Z YPeVk88UAkDGGVPmNwCIY/hBjBKR/HZEUOsLKzNjRnL+ae4CvoUd7WoFv4it4HS0mRIr nBepdCF0G3WMBHJMrpmOIu5JvgG7osQhsSHIG69UGELHmILHTTzkY7XvsuHP/kO4E9tP t+fg== MIME-Version: 1.0 X-Received: by 10.180.80.229 with SMTP id u5mr49023525wix.92.1437653533927; Thu, 23 Jul 2015 05:12:13 -0700 (PDT) Received: by 10.28.50.137 with HTTP; Thu, 23 Jul 2015 05:12:13 -0700 (PDT) Date: Thu, 23 Jul 2015 14:12:13 +0200 Message-ID: Subject: Job stuck at "Assigning split to host..." From: Lydia Ickler To: user@flink.apache.org Content-Type: multipart/alternative; boundary=f46d04428e40332e5c051b89cc8c --f46d04428e40332e5c051b89cc8c Content-Type: text/plain; charset=UTF-8 Hi, I am trying to read data from a HBase Table via the HBaseReadExample.java Unfortunately, my run gets always stuck at the same position. Do you guys have any suggestions? In the master node it says: 14:05:04,239 INFO org.apache.flink.runtime.jobmanager.JobManager - Received job bb9560efb8117ce7e840bea2c4b967c1 (Flink Java Job at Thu Jul 23 14:04:57 CEST 2015). 14:05:04,268 INFO org.apache.flink.addons.hbase.TableInputFormat - Initializing HBaseConfiguration 14:05:04,346 INFO org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Process identifier=hconnection-0x6704d3b4 connecting to ZooKeeper ensemble=localhost:2181 14:05:04,347 INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x6704d3b40x0, quorum=localhost:2181, baseZNode=/hbase 14:05:04,352 INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 14:05:04,353 INFO org.apache.zookeeper.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session 14:05:04,376 INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid = 0x24ebaaf7d06000a, negotiated timeout = 40000 14:05:04,637 INFO org.apache.flink.addons.hbase.TableInputFormat - Created 4 splits 14:05:04,637 INFO org.apache.flink.addons.hbase.TableInputFormat - created split [0|[grips5:16020]|-|LUAD+5781] 14:05:04,637 INFO org.apache.flink.addons.hbase.TableInputFormat - created split [1|[grips1:16020]|LUAD+5781|LUAD+7539] 14:05:04,637 INFO org.apache.flink.addons.hbase.TableInputFormat - created split [2|[grips1:16020]|LUAD+7539|LUAD+8552] 14:05:04,637 INFO org.apache.flink.addons.hbase.TableInputFormat - created split [3|[grips1:16020]|LUAD+8552|-] 14:05:04,641 INFO org.apache.flink.runtime.jobmanager.JobManager - Scheduling job Flink Java Job at Thu Jul 23 14:04:57 CEST 2015. 14:05:04,642 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (org.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (collect()) (1/1) (94de8700cefe1651558e25c98829a156) switched from CREATED to SCHEDULED 14:05:04,643 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (org.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (collect()) (1/1) (94de8700cefe1651558e25c98829a156) switched from SCHEDULED to DEPLOYING 14:05:04,643 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (org.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (collect()) (1/1) (attempt #0) to grips4 14:05:04,647 INFO org.apache.flink.runtime.jobmanager.JobManager - Status of job bb9560efb8117ce7e840bea2c4b967c1 (Flink Java Job at Thu Jul 23 14:04:57 CEST 2015) changed to RUNNING. 14:05:07,537 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (org.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (collect()) (1/1) (94de8700cefe1651558e25c98829a156) switched from DEPLOYING to RUNNING 14:05:07,545 INFO org.apache.flink.api.common.io.LocatableInputSplitAssigner - Assigning remote split to host grips4 14:05:08,338 INFO org.apache.flink.api.common.io.LocatableInputSplitAssigner - Assigning remote split to host grips4 And in node "grips4": 07,273 INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2181 sessionTi$ 14:05:07,296 INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will n$ 14:05:07,300 INFO org.apache.zookeeper.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:2181, initiatin$ 14:05:07,332 INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:2181, s$ 14:05:07,531 INFO org.apache.flink.runtime.taskmanager.Task - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (org$ 14:05:07,970 INFO org.apache.flink.addons.hbase.TableInputFormat - opening split [3|[grips1:16020]|LUAD+8552|-] 14:05:08,223 INFO org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation - Closing zookeeper sessionid=0x44ebaaf7d35000e 14:05:08,235 INFO org.apache.zookeeper.ZooKeeper - Session: 0x44ebaaf7d35000e closed 14:05:08,235 INFO org.apache.zookeeper.ClientCnxn - EventThread shut down 14:05:08,337 INFO org.apache.flink.addons.hbase.TableInputFormat - Closing split (scanned 129 rows) 14:05:08,343 INFO org.apache.flink.addons.hbase.TableInputFormat - opening split [2|[grips1:16020]|LUAD+7539|LUAD+8552] 14:06:58,826 INFO org.apache.hadoop.hbase.client.RpcRetryingCaller - Call exception, tries=10, retries=35, retryTime=110483ms, msg=row 'L$ 14:07:18,927 INFO org.apache.hadoop.hbase.client.RpcRetryingCaller - Call exception, tries=11, retries=35, retryTime=130584ms, msg=row 'L$ 14:07:39,079 INFO org.apache.hadoop.hbase.client.RpcRetryingCaller - Call exception, tries=12, retries=35, retryTime=150735ms, msg=row 'L$ 14:07:59,232 INFO org.apache.hadoop.hbase.client.RpcRetryingCaller - Call exception, tries=13, retries=35, retryTime=170889ms, msg=row 'L$ --f46d04428e40332e5c051b89cc8c Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi,

I am trying to read data from a HBa= se Table via the HBaseReadExample.java
Unfortunately, my run gets= always stuck at the same position.
Do you guys have any suggestions?

In the master node it says:
14:05:04,239 IN=
FO  org.apache.flink.runtime.jobmanager.JobManager                - Receive=
d job bb9560efb8117ce7e840bea2c4b967c1 (Flink Java Job at Thu Jul 23 14:04:=
57 CEST 2015).
14:05:04,268 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - Initializing HBaseConfiguration
14:05:04,346 INFO  org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper  =
      - Process identifier=3Dhconnection-0x6704d3b4 connecting to ZooKeeper=
 ensemble=3Dlocalhost:2181
14:05:04,347 INFO  org.apache.zookeeper.ZooKeeper                          =
      - Initiating client connection, connectString=3Dlocalhost:2181 sessio=
nTimeout=3D90000 watcher=3Dhconnection-0x6704d3b40x0, quorum=3Dlocalhost:21=
81, baseZNode=3D/hbase
14:05:04,352 INFO  org.apache.zookeeper.ClientCnxn                         =
      - Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate=
 using SASL (unknown error)
14:05:04,353 INFO  org.apache.zookeeper.ClientCnxn                         =
      - Socket connection established to 127.0.0.1/127.0.0.1:2181, initiating session
14:05:04,376 INFO  org.apache.zookeeper.ClientCnxn                         =
      - Session establishment complete on server 127.0.0.1/127.0.0.1:2181, sessionid =3D 0x24ebaaf7d06=
000a, negotiated timeout =3D 40000
14:05:04,637 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - Created 4 splits
14:05:04,637 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - created split [0|[grips5:16020]|-|LUAD+5781]
14:05:04,637 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - created split [1|[grips1:16020]|LUAD+5781|LUAD+7539]
14:05:04,637 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - created split [2|[grips1:16020]|LUAD+7539|LUAD+8552]
14:05:04,637 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - created split [3|[grips1:16020]|LUAD+8552|-]
14:05:04,641 INFO  org.apache.flink.runtime.jobmanager.JobManager          =
      - Scheduling job Flink Java Job at Thu Jul 23 14:04:57 CEST 2015.
14:05:04,642 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph  =
      - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (or=
g.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (collect()) =
(1/1) (94de8700cefe1651558e25c98829a156) switched from CREATED to SCHEDULED
14:05:04,643 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph  =
      - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (or=
g.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (collect()) =
(1/1) (94de8700cefe1651558e25c98829a156) switched from SCHEDULED to DEPLOYI=
NG
14:05:04,643 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph  =
      - Deploying CHAIN DataSource (at createInput(ExecutionEnvironment.jav=
a:502) (org.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (c=
ollect()) (1/1) (attempt #0) to grips4
14:05:04,647 INFO  org.apache.flink.runtime.jobmanager.JobManager          =
      - Status of job bb9560efb8117ce7e840bea2c4b967c1 (Flink Java Job at T=
hu Jul 23 14:04:57 CEST 2015) changed to RUNNING.
14:05:07,537 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph  =
      - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (or=
g.apache.flink.addons.hbase.HBaseReadExample$1)) -> FlatMap (collect()) =
(1/1) (94de8700cefe1651558e25c98829a156) switched from DEPLOYING to RUNNING
14:05:07,545 INFO  org.apache.flink.api.common.io.LocatableInputSplitAssign=
er    - Assigning remote split to host grips4
14:05:08,338 INFO  org.apache.flink.api.common.io.LocatableInputSplitAssign=
er    - Assigning remote split to host grips4

And in node &quo=
t;grips4":
07,273 INFO  org.apache.zookeepe=
r.ZooKeeper                                - Initiating client connection, =
connectString=3Dlocalhost:2181 sessionTi$
14:05:07,296 INFO  org.apache.zookeeper.ClientCnxn                         =
      - Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will n$
14:05:07,300 INFO  org.apache.zookeeper.ClientCnxn                         =
      - Socket connection established to 127.0.0.1/127.0.0.1:2181, initiatin$
14:05:07,332 INFO  org.apache.zookeeper.ClientCnxn                         =
      - Session establishment complete on server 127.0.0.1/127.0.0.1:2181, s$
14:05:07,531 INFO  org.apache.flink.runtime.taskmanager.Task               =
      - CHAIN DataSource (at createInput(ExecutionEnvironment.java:502) (or=
g$
14:05:07,970 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - opening split [3|[grips1:16020]|LUAD+8552|-]
14:05:08,223 INFO  org.apache.hadoop.hbase.client.HConnectionManager$HConne=
ctionImplementation  - Closing zookeeper sessionid=3D0x44ebaaf7d35000e
14:05:08,235 INFO  org.apache.zookeeper.ZooKeeper                          =
      - Session: 0x44ebaaf7d35000e closed
14:05:08,235 INFO  org.apache.zookeeper.ClientCnxn                         =
      - EventThread shut down
14:05:08,337 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - Closing split (scanned 129 rows)
14:05:08,343 INFO  org.apache.flink.addons.hbase.TableInputFormat          =
      - opening split [2|[grips1:16020]|LUAD+7539|LUAD+8552]
14:06:58,826 INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller        =
      - Call exception, tries=3D10, retries=3D35, retryTime=3D110483ms, msg=
=3Drow 'L$
14:07:18,927 INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller        =
      - Call exception, tries=3D11, retries=3D35, retryTime=3D130584ms, msg=
=3Drow 'L$
14:07:39,079 INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller        =
      - Call exception, tries=3D12, retries=3D35, retryTime=3D150735ms, msg=
=3Drow 'L$
14:07:59,232 INFO  org.apache.hadoop.hbase.client.RpcRetryingCaller        =
      - Call exception, tries=3D13, retries=3D35, retryTime=3D170889ms, msg=
=3Drow 'L$

--f46d04428e40332e5c051b89cc8c--