hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-hudi] adamjoneill edited a comment on issue #1325: presto - querying nested object in parquet file created by hudi
Date Thu, 13 Feb 2020 13:14:25 GMT
adamjoneill edited a comment on issue #1325: presto - querying nested object in parquet file
created by hudi
URL: https://github.com/apache/incubator-hudi/issues/1325#issuecomment-585748045
 
 
   Futher update
   I've narrowed it down to the array on the nested object. 
   
   The following works when i place the following object on the kinesis stream
   
   ```
   const valueToUse = {
         ...order,
         tickets: {
           items: [],
         },
       };
   ```
   
   but when placed on the kinesis stream with an object in the array it fails
   
   ```
   const valueToUse = {
         ...order,
         tickets: {
           items: [
             {
               ticketType: {
                 id: 258815,
               },
             },
           ],
         },
       };
   ```
   
   error message and stack trace
   
   ```
   Query 20200213_131029_00032_hej8h failed: No value present
   java.util.NoSuchElementException: No value present
   	at java.util.Optional.get(Optional.java:135)
   	at com.facebook.presto.parquet.reader.ParquetReader.readArray(ParquetReader.java:156)
   	at com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:282)
   	at com.facebook.presto.parquet.reader.ParquetReader.readStruct(ParquetReader.java:193)
   	at com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:276)
   	at com.facebook.presto.parquet.reader.ParquetReader.readStruct(ParquetReader.java:193)
   	at com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:276)
   	at com.facebook.presto.parquet.reader.ParquetReader.readStruct(ParquetReader.java:193)
   	at com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:276)
   	at com.facebook.presto.parquet.reader.ParquetReader.readBlock(ParquetReader.java:268)
   	at com.facebook.presto.hive.parquet.ParquetPageSource$ParquetBlockLoader.load(ParquetPageSource.java:247)
   	at com.facebook.presto.hive.parquet.ParquetPageSource$ParquetBlockLoader.load(ParquetPageSource.java:225)
   	at com.facebook.presto.spi.block.LazyBlock.assureLoaded(LazyBlock.java:283)
   	at com.facebook.presto.spi.block.LazyBlock.getLoadedBlock(LazyBlock.java:274)
   	at com.facebook.presto.spi.Page.getLoadedPage(Page.java:261)
   	at com.facebook.presto.operator.TableScanOperator.getOutput(TableScanOperator.java:254)
   	at com.facebook.presto.operator.Driver.processInternal(Driver.java:379)
   	at com.facebook.presto.operator.Driver.lambda$processFor$8(Driver.java:283)
   	at com.facebook.presto.operator.Driver.tryWithLock(Driver.java:675)
   	at com.facebook.presto.operator.Driver.processFor(Driver.java:276)
   	at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:1077)
   	at com.facebook.presto.execution.executor.PrioritizedSplitRunner.process(PrioritizedSplitRunner.java:162)
   	at com.facebook.presto.execution.executor.TaskExecutor$TaskRunner.run(TaskExecutor.java:483)
   	at com.facebook.presto.$gen.Presto_0_227____20200211_134743_1.run(Unknown Source)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message