From 12a5b40411c93c785a3093fbb632887310048d9f Mon Sep 17 00:00:00 2001 From: Chris Lu Date: Thu, 13 Dec 2018 11:29:47 -0800 Subject: [PATCH] Updated Hadoop Compatible File System (markdown) --- Hadoop-Compatible-File-System.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/Hadoop-Compatible-File-System.md b/Hadoop-Compatible-File-System.md index e8e8049..f1026d3 100644 --- a/Hadoop-Compatible-File-System.md +++ b/Hadoop-Compatible-File-System.md @@ -72,6 +72,13 @@ $ bin/hdfs dfs -ls / $ bin/hdfs dfs -ls seaweedfs://localhost:8888/ ``` +# Installation for Spark +Follow instructions on spark doc: +* https://spark.apache.org/docs/latest/configuration.html#inheriting-hadoop-cluster-configuration +* https://spark.apache.org/docs/latest/configuration.html#custom-hadoophive-configuration + +Inheriting from Hadoop cluster configuration should be the easiest way. + # Installation for HBase If HBase is used, create a folder and configure the HBase root directory in `etc/hbase/conf/hbase-site.xml`: