drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5229) Upgrade kudu client to org.apache.kudu:kudu-client:1.2.0
Date Tue, 23 May 2017 17:02:04 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021475#comment-16021475
] 

ASF GitHub Bot commented on DRILL-5229:
---------------------------------------

Github user eskabetxe commented on the issue:

    https://github.com/apache/drill/pull/828
  
    `java.lang.IllegalStateException: com.fasterxml.jackson.databind.JsonMappingException:
Could not resolve type id 'maprdb' into a subtype of [simple type, class org.apache.drill.common.logical.FormatPluginConfig]:
known type ids = [FormatPluginConfig, avro, httpd, json, named, parquet, sequencefile, text]
     at [Source: {
      "storage":{
        dfs: {
          type: "file",
          connection: "maprfs:///",
          workspaces: {
            "root" : {
              location: "/",
              writable: false
            },
            "tmp" : {
              location: "/tmp",
              writable: true,
              storageformat: "csv"
            }
          },
          formats: {
            "psv" : {
              type: "text",
              extensions: [ "tbl" ],
              delimiter: "|"
            },
            "csv" : {
              type: "text",
              extensions: [ "csv" ],
              delimiter: ","
            },
            "tsv" : {
              type: "text",
              extensions: [ "tsv" ],
              delimiter: "\t"
            },
            "parquet" : {
              type: "parquet"
            },
            "json" : {
              type: "json"
            },
            "maprdb" : {
              type: "maprdb"
            }
          }
        },
    
        cp: {
          type: "file",
          connection: "classpath:///",
          formats: {
            "json" : {
              type: "json"
            },
            "parquet" : {
              type: "parquet"
            }
          }
        }
      }
    }
    ; line: 40, column: 17] (through reference chain: org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["dfs"]->org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
    
    	at org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:185)
    	at org.apache.drill.exec.store.StoragePluginRegistryImpl.init(StoragePluginRegistryImpl.java:128)
    	at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:122)
    	at org.apache.drill.BaseTestQuery.openClient(BaseTestQuery.java:198)
    	at org.apache.drill.BaseTestQuery.openClient(BaseTestQuery.java:186)
    	at org.apache.drill.BaseTestQuery.setupDefaultTestCluster(BaseTestQuery.java:127)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
    	at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51)
    	at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237)
    	at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
    Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not resolve type
id 'maprdb' into a subtype of [simple type, class org.apache.drill.common.logical.FormatPluginConfig]:
known type ids = [FormatPluginConfig, avro, httpd, json, named, parquet, sequencefile, text]
     at [Source: {
      "storage":{
        dfs: {
          type: "file",
          connection: "maprfs:///",
          workspaces: {
            "root" : {
              location: "/",
              writable: false
            },
            "tmp" : {
              location: "/tmp",
              writable: true,
              storageformat: "csv"
            }
          },
          formats: {
            "psv" : {
              type: "text",
              extensions: [ "tbl" ],
              delimiter: "|"
            },
            "csv" : {
              type: "text",
              extensions: [ "csv" ],
              delimiter: ","
            },
            "tsv" : {
              type: "text",
              extensions: [ "tsv" ],
              delimiter: "\t"
            },
            "parquet" : {
              type: "parquet"
            },
            "json" : {
              type: "json"
            },
            "maprdb" : {
              type: "maprdb"
            }
          }
        },
    
        cp: {
          type: "file",
          connection: "classpath:///",
          formats: {
            "json" : {
              type: "json"
            },
            "parquet" : {
              type: "parquet"
            }
          }
        }
      }
    }
    ; line: 40, column: 17] (through reference chain: org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["dfs"]->org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
    	at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:216)
    	at com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:983)
    	at com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._handleUnknownTypeId(TypeDeserializerBase.java:281)
    	at com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:163)
    	at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:106)
    	at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:91)
    	at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:142)
    	at com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:497)
    	at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:341)
    	at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
    	at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490)
    	at com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:101)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:260)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:163)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:135)
    	at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:120)
    	at com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:91)
    	at com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:142)
    	at com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:497)
    	at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:341)
    	at com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
    	at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298)
    	at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133)
    	at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3788)
    	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2779)
    	at org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:147)
    	... 16 more
    `


> Upgrade kudu client to org.apache.kudu:kudu-client:1.2.0 
> ---------------------------------------------------------
>
>                 Key: DRILL-5229
>                 URL: https://issues.apache.org/jira/browse/DRILL-5229
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Other
>    Affects Versions: 1.8.0
>            Reporter: Rahul Raj
>             Fix For: 2.0.0
>
>
> Getting an error -" out-of-order key" for a query select v,count(k) from
> kudu.test group by v where k is the primary key. This happens only when the
> aggregation is done on primary key. Should drill move to the latest kudu
> client to investigate this further?
> Current drill kudu connector uses org.kududb:kudu-client:0.6.0 from
> cloudera repository, where the latest released library
> org.apache.kudu:kudu-client:1.2.0 is hosted on maven central. There are a
> few breaking changes with the new library:
>    1. TIMESTAMP renamed to UNIXTIME_MICROS
>    2. In KuduRecordReader#setup -
>    KuduScannerBuilder#lowerBoundPartitionKeyRaw renamed to lowerBoundRaw
>    andKuduScannerBuilder#exclusiveUpperBoundPartitionKeyRaw renamed
>    exclusiveUpperBoundRaw. Both methods are deprecated.
>    3. In KuduRecordWriterImpl#updateSchema - client.createTable(name,
>    kuduSchema) requires CreateTableOperatios as the third argument



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message