Updated Hadoop Compatible File System (markdown)

Chris Lu committed 2018-12-09 19:27:32 -08:00
1 parent a2a5a07267
commit ca37b3060a
1 file changed
+7 -4
+7 -4
@@ -8,11 +8,14 @@ $cd $GOPATH/src/github.com/chrislusf/seaweedfs/other/java/client
$ mvn install
$cd $GOPATH/src/github.com/chrislusf/seaweedfs/other/java/hdfs
$ mvn package
$ ls -al target/seaweedfs-hadoop-client-1.0.jar
$ ls -al target/seaweedfs-hadoop-client-1.0.1.jar
```
Or you can download it from MavenCentral
https://oss.sonatype.org/content/repositories/public/com/github/chrislusf/seaweedfs-hadoop-client/1.0/seaweedfs-hadoop-client-1.0.jar
https://oss.sonatype.org/content/repositories/public/com/github/chrislusf/seaweedfs-hadoop-client/
https://oss.sonatype.org/content/repositories/public/com/github/chrislusf/seaweedfs-hadoop-client/1.0.1/seaweedfs-hadoop-client-1.0.1.jar
# Test SeaweedFS on Hadoop
@@ -26,7 +29,7 @@ $ cd ${HADOOP_HOME}
$ echo "<configuration></configuration>" > etc/hadoop/mapred-site.xml
$ bin/hdfs dfs -Dfs.defaultFS=seaweedfs://localhost:8888 \
-Dfs.seaweedfs.impl=seaweed.hdfs.SeaweedFileSystem \
-libjars ./seaweedfs-hadoop-client-1.0.jar \
-libjars ./seaweedfs-hadoop-client-1.0.1.jar \
-ls /
```
@@ -56,7 +59,7 @@ $ bin/hadoop classpath
# Copy SeaweedFS HDFS client jar to one of the folders
$ cd ${HADOOP_HOME}
$ cp ./seaweedfs-hadoop-client-1.0.jar share/hadoop/common/lib/
$ cp ./seaweedfs-hadoop-client-1.0.1.jar share/hadoop/common/lib/
```
Now you can do this: