hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18117) Create TestCliDriver for HDFS EC
Date Wed, 23 May 2018 17:04:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487655#comment-16487655
] 

Sahil Takiar commented on HIVE-18117:
-------------------------------------

No worries, thanks for being so diligent on this.

> Create TestCliDriver for HDFS EC
> --------------------------------
>
>                 Key: HIVE-18117
>                 URL: https://issues.apache.org/jira/browse/HIVE-18117
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sahil Takiar
>            Assignee: Andrew Sherman
>            Priority: Major
>         Attachments: HIVE-18117.1.patch, HIVE-18117.2.patch, HIVE-18117.3.patch, HIVE-18117.4.patch,
HIVE-18117.5.patch, HIVE-18117.6.patch, HIVE-18117.7.patch, HIVE-18117.8.patch, HIVE-18117.9.patch
>
>
> Should be able to do something similar to what we do for HDFS encryption.
> TestErasureCodingHDFSCliDriver uses a test-only CommandProcessor "ErasureProcessor"
> which allows .q files to contain Erasure Coding commands similar to those provided
> by the hdfs ec command
> https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html.
> The Erasure Coding functionality is exposed through a new shim "HdfsFileErasureCodingPolicy".
> At this stage there are two .q files:
> erasure_commnds.q (a simple test to show ERASURE commands can run on local fs via
> TestCliDriver or on hdfs via TestErasureCodingHDFSCliDriver), and
> erasure_simple.q (which does some trivial queries to demonstrate basic functionality).
> More tests will come in future commits.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message