carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jackylk <...@git.apache.org>
Subject [GitHub] carbondata pull request #1669: [CARBONDATA-1880] Combine input small files f...
Date Sun, 17 Dec 2017 02:37:53 GMT
Github user jackylk commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/1669#discussion_r157356369
  
    --- Diff: integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
    @@ -160,4 +162,112 @@ object DataLoadProcessBuilderOnSpark {
           Array((uniqueLoadStatusId, (loadMetadataDetails, executionErrors)))
         }
       }
    +
    +  /**
    +   * use FileScanRDD to read input csv files
    --- End diff --
    
    change comment to mention this function creates a RDD that does reading of multiple CSV
files


---

Mime
View raw message