zeppelin-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zjf...@apache.org
Subject zeppelin git commit: ZEPPELIN-3745. Disable CRC check of hadoop FileSystem
Date Thu, 30 Aug 2018 03:23:55 GMT
Repository: zeppelin
Updated Branches:
  refs/heads/branch-0.8 cb3b0f4b3 -> ea861f456


ZEPPELIN-3745. Disable CRC check of hadoop FileSystem

### What is this PR for?
Trivial PR to disable CRC check of hadoop FileSystem, otherwise we may get error if we manually
change the file content of interpreter-setting.json

### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3745

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3162 from zjffdu/ZEPPELIN-3745 and squashes the following commits:

67dc70df2 [Jeff Zhang] ZEPPELIN-3745. Disable CRC check of hadoop FileSystem

(cherry picked from commit 26b554d64123490ceee1b05c77e3ea51dbff6412)
Signed-off-by: Jeff Zhang <zjffdu@apache.org>


Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo
Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/ea861f45
Tree: http://git-wip-us.apache.org/repos/asf/zeppelin/tree/ea861f45
Diff: http://git-wip-us.apache.org/repos/asf/zeppelin/diff/ea861f45

Branch: refs/heads/branch-0.8
Commit: ea861f4563196908301cb4c3aed6eda893a6d862
Parents: cb3b0f4
Author: Jeff Zhang <zjffdu@apache.org>
Authored: Fri Aug 24 10:08:08 2018 +0800
Committer: Jeff Zhang <zjffdu@apache.org>
Committed: Thu Aug 30 11:23:39 2018 +0800

----------------------------------------------------------------------
 .../main/java/org/apache/zeppelin/notebook/FileSystemStorage.java  | 2 ++
 1 file changed, 2 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/zeppelin/blob/ea861f45/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
----------------------------------------------------------------------
diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
index 4670e20..ebec118 100644
--- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
+++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
@@ -62,6 +62,8 @@ public class FileSystemStorage {
     this.hadoopConf = new Configuration();
     // disable checksum for local file system. because interpreter.json may be updated by
     // non-hadoop filesystem api
+    // disable caching for file:// scheme to avoid getting LocalFS which does CRC checks
+    this.hadoopConf.setBoolean("fs.file.impl.disable.cache", true);
     this.hadoopConf.set("fs.file.impl", RawLocalFileSystem.class.getName());
     this.isSecurityEnabled = UserGroupInformation.isSecurityEnabled();
 


Mime
View raw message