flink-user-zh mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shao.hongxiao" <17611022...@163.com>
Subject 本地测试 flink 1.10 hbase sql create table 在反序列化byte之后得到的对象conf配置为null,导致无法连接hbase集群
Date Fri, 22 May 2020 03:48:49 GMT
一下是我的程序
sql
val hbaseTable =
      """
        |CREATE TABLE pvuv_sink(
        |    user_id varchar,
        |    f ROW<item_id varchar,category_id varchar,cnt BIGINT>
        |) WITH (
        |    'connector.type' = 'hbase',
        |    'connector.version' = '1.4.3',
        |    'connector.table-name' = 'test_shx',
        |    'connector.zookeeper.quorum' = 'docker-hbase:2181',
        |    'connector.zookeeper.znode.parent' = '/hbase'
        |)
      """.stripMargin.toString


 val bsEnv = StreamExecutionEnvironment.getExecutionEnvironment    bsEnv.setStreamTimeCharacteristic(TimeCharacteristic.ProcessingTime)
 bsEnv.setParallelism(1)
    val bsSettings = EnvironmentSettings.newInstance().useBlinkPlanner().inStreamingMode().build()
    val bsTableEnv = StreamTableEnvironment.create(bsEnv, bsSettings)
bsTableEnv.sqlUpdate(hbaseTable)
bsTableEnv.execute("SQL Job")


报错
job graph 阶段
HBaseRowInputFormat.java 
this.conf = {Configuration@4841} "Configuration: core-default.xml, core-site.xml, hbase-default.xml,
hbase-site.xml"
quietmode = true
allowNullValueProperties = false
resources = {ArrayList@4859}  size = 2
finalParameters = {Collections$SetFromMap@4860}  size = 0
loadDefaults = true
updatingResource = {ConcurrentHashMap@4861}  size = 343
properties = {Properties@4862}  size = 343
overlay = {Properties@4863}  size = 2
classLoader = {Launcher$AppClassLoader@4864} 

Executor job 阶段  InstantiationUtil.java    readObjectFromConfig
userCodeObject = {HBaseRowInputFormat@13658} 
tableName = "test_shx"
schema = {HBaseTableSchema@13660} 
conf = null
readHelper = null
endReached = false
table = null
scan = null
resultScanner = null
currentRow = null
scannedRows = 0
runtimeContext = null


恳请各位大神相帮



| |
邵红晓
|
|
邮箱:17611022895@163.com
|
签名由网易邮箱大师定制
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message