carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang Chen (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CARBONDATA-1337) Problem while intermediate merging
Date Sat, 29 Jul 2017 01:36:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Liang Chen resolved CARBONDATA-1337.
------------------------------------
    Resolution: Fixed

> Problem while intermediate merging
> ----------------------------------
>
>                 Key: CARBONDATA-1337
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1337
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 1.2.0
>            Reporter: Zhichao  Zhang
>            Assignee: Zhichao  Zhang
>            Priority: Minor
>             Fix For: 1.2.0
>
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> With PR-1198(CARBONDATA-1281), when loading data, there was error occuring, as following:
> {code:java}
> 2017-07-28 13:10:49,443 - ERROR - org.apache.carbondata.common.logging.impl.StandardLogService.logErrorMessage(StandardLogService.java:143)
- pool-17-thread-1 -pool-17-thread-1 Problem while intermediate merging
> org.apache.carbondata.processing.sortandgroupby.exception.CarbonSortKeyAndGroupByException:
Problem while getting the file
>         at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.initialize(IntermediateFileMerger.java:168)
>         at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.call(IntermediateFileMerger.java:110)
>         at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.call(IntermediateFileMerger.java:37)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.FileNotFoundException: [Ljava.lang.String;@54218780/carbondata_hundred_million_pr11987419814281939480.merge
(No such file or directory)
>         at java.io.FileOutputStream.open0(Native Method)
>         at java.io.FileOutputStream.open(FileOutputStream.java:270)
>         at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
>         at java.io.FileOutputStream.<init>(FileOutputStream.java:162)
>         at org.apache.carbondata.processing.sortandgroupby.sortdata.IntermediateFileMerger.initialize(IntermediateFileMerger.java:163)
>         ... 6 more
> {code}
> According to xuchuanyin's suggestion, it needs to fix the code of method  SortIntermediateFileMerger.startIntermediateMerging.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message