drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dave Watson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-1798) write a BigInt type when you are using a ValueWriter of type NullableVarCharWriterImpl
Date Sun, 15 Feb 2015 16:42:13 GMT

    [ https://issues.apache.org/jira/browse/DRILL-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322066#comment-14322066
] 

Dave Watson commented on DRILL-1798:
------------------------------------

Seem to encounter same bug when reading a JSON file

The reproduction here:

wget http://api.openweathermap.org/data/2.5/history/city?q=London

mv *London /home/weather/london.json

In SQLLINE

0: jdbc:drill:zk=local> select * from dfs.`/home/weather/london.json`;
Query failed: Query stopped., You tried to write a BigInt type when you are using a ValueWriter
of type NullableFloat8WriterImpl. [ 5f4b624e-a094-4246-ba7e-50a30e0cb79c on ubuntu14.novalocal:31010
]


Error: exception while executing query: Failure while executing query. (state=,code=0)




> write a BigInt type when you are using a ValueWriter of type NullableVarCharWriterImpl
> --------------------------------------------------------------------------------------
>
>                 Key: DRILL-1798
>                 URL: https://issues.apache.org/jira/browse/DRILL-1798
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>    Affects Versions: 0.7.0
>            Reporter: Chun Chang
>
> #Mon Dec 01 11:15:02 PST 2014
> git.commit.id.abbrev=a60e1db
> My data looks like this:
> 0: jdbc:drill:schema=dfs.drillTestDir> select t.service_provider_set_1d.`map`[0] from
`es/dpa-nested` as t limit 10;
> +------------+
> |   EXPR$0   |
> +------------+
> | {"key":"WhatA","value":1} |
> | {}         |
> | {"key":"WhatB","value":2} |
> | {}         |
> | {"key":"WhatB","value":2} |
> | {}         |
> | {"key":"WhatA","value":2} |
> | {}         |
> | {"key":"WhatC","value":2} |
> | {"key":"WhatC","value":2} |
> +------------+
> 0: jdbc:drill:schema=dfs.drillTestDir> select t.service_provider_set_1d.`map`[0].`value`
from `es/dpa-nested` as t limit 1;
> Query failed: Query failed: Failure while running fragment.[ ec75d174-ffa5-4e6e-98ad-6c99979b9fa5
on qa-node120.qa.lab:31010 ]
> [ ec75d174-ffa5-4e6e-98ad-6c99979b9fa5 on qa-node120.qa.lab:31010 ]
> Error: exception while executing query: Failure while executing query. (state=,code=0)
> stack:
> 16:48:57.682 [2b82f385-b5bc-a2af-83ee-1f54c1c24ae5:frag:0:0] ERROR o.a.drill.exec.ops.FragmentContext
- Fragment Context received failure.
> java.lang.IllegalArgumentException: You tried to write a BigInt type when you are using
a ValueWriter of type NullableVarCharWriterImpl.
> 	at org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.fail(AbstractFieldWriter.java:625)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> 	at org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.write(AbstractFieldWriter.java:185)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> 	at org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.write(NullableVarCharWriterImpl.java:88)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> 	at org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter$DrillBigIntConverter.addLong(DrillParquetGroupConverter.java:330)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> 	at parquet.column.impl.ColumnReaderImpl$2$4.writeValue(ColumnReaderImpl.java:258) ~[parquet-column-1.5.1-drill-r5.jar:na]
> 	at parquet.column.impl.ColumnReaderImpl.writeCurrentValueToConverter(ColumnReaderImpl.java:354)
~[parquet-column-1.5.1-drill-r5.jar:na]
> 	at parquet.io.RecordReaderImplementation.read(RecordReaderImplementation.java:400) ~[parquet-column-1.5.1-drill-r5.jar:na]
> 	at org.apache.drill.exec.store.parquet2.DrillParquetReader.next(DrillParquetReader.java:288)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> 	at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:191) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> 	at org.apache.drill.exec.physical.impl.ScanBatch.buildSchema(ScanBatch.java:125) [drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> 	at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.buildSchema(IteratorValidatorBatchIterator.java:80)
[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message