orc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From majetideepak <...@git.apache.org>
Subject [GitHub] orc pull request #126: ORC-191 Implement RLE v1 encoder
Date Tue, 23 May 2017 00:29:10 GMT
Github user majetideepak commented on a diff in the pull request:

    https://github.com/apache/orc/pull/126#discussion_r117869197
  
    --- Diff: c++/src/ByteRLE.cc ---
    @@ -27,6 +27,272 @@
     namespace orc {
     
       const size_t MINIMUM_REPEAT = 3;
    +  const size_t MAXIMUM_REPEAT = 127 + MINIMUM_REPEAT;
    +  const size_t MAX_LITERAL_SIZE = 128;
    +
    +  ByteRleEncoder::~ByteRleEncoder() {
    +    // PASS
    +  }
    +
    +  class ByteRleEncoderImpl : public ByteRleEncoder {
    +  public:
    +    ByteRleEncoderImpl(std::unique_ptr<BufferedOutputStream> output);
    +    virtual ~ByteRleEncoderImpl();
    +
    +    /**
    +     * Encode the next batch of values
    +     * @param data to be encoded
    +     * @param numValues the number of values to be encoded
    +     * @param notNull If the pointer is null, all values are read. If the
    +     *    pointer is not null, positions that are false are skipped.
    +     */
    +    virtual void add(const char* data, uint64_t numValues,
    +                      const char* notNull) override;
    +
    +    /**
    +     * Get size of buffer used so far.
    +     */
    +    virtual uint64_t getBufferSize() const override;
    +
    +    /**
    +     * Flushing underlying BufferedOutputStream
    +    */
    +    virtual uint64_t flush() override;
    +
    +    virtual void recordPosition(PositionRecorder* recorder) const override;
    +
    +  protected:
    +    std::unique_ptr<BufferedOutputStream> outputStream;
    +    char * literals;
    --- End diff --
    
    `char*` (remove space)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message