Github-Mirror/seaweedfs
1
0 Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-11-05 11:37:44 +01:00
Code Issues Packages Projects Releases Wiki Activity

Updated run Spark on SeaweedFS (markdown)

Chris Lu committed 2020-09-28 21:12:48 -07:00
1 parent 8d9e04d14d
commit caf9033926
1 file changed
+2 -2
Download Patch File Download Diff File Expand all files Collapse all files
run-Spark-on-SeaweedFS.md
+2 -2
@@ -15,8 +15,8 @@ Copy the seaweedfs-hadoop2-client-x.x.x.jar to all executor machines.
Add the following to spark/conf/spark-defaults.conf on every node running Spark
```
spark.driver.extraClassPath /path/to/seaweedfs-hadoop2-client-x.x.x.jar
spark.executor.extraClassPath /path/to/seaweedfs-hadoop2-client-x.x.x.jar
spark.driver.extraClassPath=/path/to/seaweedfs-hadoop2-client-1.4.8.jar
spark.executor.extraClassPath=/path/to/seaweedfs-hadoop2-client-1.4.8.jar
```
And modify the configuration at runntime: