diff --git a/Hadoop-Compatible-File-System.md b/Hadoop-Compatible-File-System.md index e8e8049..f1026d3 100644 --- a/Hadoop-Compatible-File-System.md +++ b/Hadoop-Compatible-File-System.md @@ -72,6 +72,13 @@ $ bin/hdfs dfs -ls / $ bin/hdfs dfs -ls seaweedfs://localhost:8888/ ``` +# Installation for Spark +Follow instructions on spark doc: +* https://spark.apache.org/docs/latest/configuration.html#inheriting-hadoop-cluster-configuration +* https://spark.apache.org/docs/latest/configuration.html#custom-hadoophive-configuration + +Inheriting from Hadoop cluster configuration should be the easiest way. + # Installation for HBase If HBase is used, create a folder and configure the HBase root directory in `etc/hbase/conf/hbase-site.xml`: