drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aditya Kishore (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-1414) Offload fragment profile data to DFS rather than storing in ZooKeeper
Date Wed, 08 Oct 2014 11:55:40 GMT

     [ https://issues.apache.org/jira/browse/DRILL-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aditya Kishore updated DRILL-1414:
----------------------------------
    Summary: Offload fragment profile data to DFS rather than storing in ZooKeeper  (was:
Move profile storage to DFS rather than using PStore)

Updating JIRA summary to reflect the accurate change.

> Offload fragment profile data to DFS rather than storing in ZooKeeper
> ---------------------------------------------------------------------
>
>                 Key: DRILL-1414
>                 URL: https://issues.apache.org/jira/browse/DRILL-1414
>             Project: Apache Drill
>          Issue Type: Improvement
>            Reporter: Jacques Nadeau
>            Assignee: Aditya Kishore
>             Fix For: 0.6.0
>
>         Attachments: DRILL-1414-Move-profile-storage-to-DFS-rather-than-u.patch, DRILL-1414-Move-profile-storage-to-DFS-rather-than-u.patch,
DRILL-1414-Move-profile-storage-to-DFS-rather-than-u.patch, DRILL-1414-Move-profile-storage-to-DFS-rather-than-u.patch
>
>
> PStores were really built for trivial configuration data, not large query profiles. 
As such, we should move to using the DFS for storage of query profiles when distributed mode.
> Release Notes:-
> By default, the blob data (hence the fragment profiles) are stored on the local file
system under {{$DRILL_LOG_DIR}} folder, however this can be moved to DFS by specifying the
target folder URL using {{"drill.exec.sys.store.provider.zk.blobroot"}} setting in Drill configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message