Github-Mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-09-18 20:40:54 +02:00
Code Issues Packages Projects Releases Wiki Activity

Updated Hadoop Compatible File System (markdown)

Chris Lu
2018-12-18 20:33:21 -08:00
parent efce396317
commit fa96022b06
1 changed files with 3 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
Hadoop-Compatible-File-System.md
+3 -6
@@ -8,15 +8,12 @@ $cd $GOPATH/src/github.com/chrislusf/seaweedfs/other/java/client
$ mvn install
$cd $GOPATH/src/github.com/chrislusf/seaweedfs/other/java/hdfs
$ mvn package
$ ls -al target/seaweedfs-hadoop-client-1.0.4.jar
$ ls -al target/seaweedfs-hadoop-client-x.x.x.jar
```
Or you can download the latest version from MavenCentral
https://mvnrepository.com/artifact/com.github.chrislusf/seaweedfs-hadoop-client
https://oss.sonatype.org/content/repositories/public/com/github/chrislusf/seaweedfs-hadoop-client/1.0.4/seaweedfs-hadoop-client-1.0.4.jar
# Test SeaweedFS on Hadoop
Suppose you are getting a new Hadoop installation. Here are the minimum steps to get SeaweedFS to run.
@@ -29,7 +26,7 @@ $ cd ${HADOOP_HOME}
$ echo "<configuration></configuration>" > etc/hadoop/mapred-site.xml
$ bin/hdfs dfs -Dfs.defaultFS=seaweedfs://localhost:8888 \
-Dfs.seaweedfs.impl=seaweed.hdfs.SeaweedFileSystem \
-libjars ./seaweedfs-hadoop-client-1.0.4.jar \
-libjars ./seaweedfs-hadoop-client-x.x.x.jar \
-ls /
```
@@ -59,7 +56,7 @@ $ bin/hadoop classpath
# Copy SeaweedFS HDFS client jar to one of the folders
$ cd ${HADOOP_HOME}
$ cp ./seaweedfs-hadoop-client-1.0.4.jar share/hadoop/common/lib/
$ cp ./seaweedfs-hadoop-client-x.x.x.jar share/hadoop/common/lib/
```
Now you can do this: