Github-Mirror/seaweedfs
1
0 Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-10-23 22:40:39 +02:00
Code Issues Packages Projects Releases Wiki Activity
7,446 Commits 224 Branches 362 Tags
bb4beebce368f9c19257cf67779b5f65e99c6e21
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
chrislu bb4beebce3 prevent nil 2022-04-05 10:49:17 -07:00
chrislu 3176bf126a update rocksdb version 2022-04-04 18:52:59 -07:00
chrislu 6e4c94e2e1 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-04-04 14:48:02 -07:00
chrislu 4aae87f405 check missing hdd disk type 2022-04-04 14:48:00 -07:00
chrislu d310711de0 avoid possible deadlock: move metadata log flush channel out of lock scope 2022-04-03 21:53:30 -07:00
chrislu 9eda9a6e82 Revert "Bump github.com/linxGnu/grocksdb from 1.6.38 to 1.7.0" 
This reverts commit c29f79a593.
 2022-04-03 20:57:30 -07:00
chrislu 77a7d7253f 2.97 2022-04-03 19:08:01 -07:00
chrislu e8d7bb42e2 avoid concurrent access to map object 
fix https://github.com/chrislusf/seaweedfs/issues/2866
 2022-04-03 01:08:25 -07:00
chrislu 6a2bcd03aa configure mount quota 2022-04-02 21:34:26 -07:00
chrislu 958f880b70 mount: add grpc method to adjust quota 2022-04-02 15:14:37 -07:00
chrislu a8eefda452 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-04-01 20:25:37 -07:00
chrislu 105578a2f2 skip pinging self for master and volume server 2022-04-01 20:25:35 -07:00
chrislu 4ecba915f3 add check between peers 2022-04-01 17:40:25 -07:00
chrislu daca2d22a5 use original server address string as map key 2022-04-01 17:34:42 -07:00
chrislu 4b5c0e3fa9 check cluster connectivities 2022-04-01 17:27:49 -07:00
chrislu 6d55716fc3 use constants 2022-04-01 16:55:26 -07:00
chrislu bbbbbd70a4 master supports grpc ping 2022-04-01 16:50:58 -07:00
chrislu 743ad690b6 filer supports grpc ping 2022-04-01 16:44:58 -07:00
chrislu 2305508b65 refactor: separate into two files 2022-04-01 16:40:49 -07:00
chrislu 800cbc004c volume server adds ping function 2022-04-01 16:37:06 -07:00
chrislu 0490ee87ef 2.96 2022-03-27 16:11:17 -07:00
chrislu 86d4c52d6e Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-26 13:33:20 -07:00
chrislu 21e0898631 refactor: change masters from a slice to a map 2022-03-26 13:33:17 -07:00
chrislu 4ba7127ab1 refactor 2022-03-26 13:13:19 -07:00
chrislu cae998eda1 Revert "Revert "remove duplicated metadata subscription in filer"" 
This reverts commit 34b743c481.
 2022-03-26 13:00:16 -07:00
chrislu 34b743c481 Revert "remove duplicated metadata subscription in filer" 
This reverts commit 34742be029.

Related to https://github.com/chrislusf/seaweedfs/issues/2545
 2022-03-26 12:33:45 -07:00
chrislu fba1cfc2d6 simplify a bit 2022-03-26 10:24:05 -07:00
chrislu a3411dd9da refactor 2022-03-26 10:21:26 -07:00
chrislu 9b04f17555 remove dead code 2022-03-23 23:18:32 -07:00
chrislu 0b5faef612 fix 2022-03-23 23:16:54 -07:00
chrislu 0562fceb99 volume: fail fast if too many concurrent requests, to avoid dead lock due to replication. 
fix https://github.com/chrislusf/seaweedfs/issues/2755
 2022-03-23 22:53:58 -07:00
chrislu 8b983729ca Update go.mod 2022-03-23 13:52:28 -07:00
chrislu e48764be75 s3: multipart upload verifies uploaded parts 2022-03-23 01:05:14 -07:00
chrislu 18ae8943ef better clean up upload directory 2022-03-23 01:03:51 -07:00
chrislu 98c001f54a Revert "Merge pull request #2789 from chrislusf/dependabot/go_modules/github.com/spf13/viper-1.10.1" 
This reverts commit 0448c05596, reversing
changes made to 7fce84532b.
 2022-03-22 11:29:31 -07:00
chrislu a0bad1c997 remove any go mod changes 
This reverts commit 6c7f7d6887.
 2022-03-21 23:04:00 -07:00
chrislu 6c7f7d6887 Revert "Merge pull request #2782 from SadmiB/upstream" 
This reverts commit a644b7236a, reversing
changes made to 349257f822.
 2022-03-21 23:00:50 -07:00
chrislu afb93cd19f Revert "Merge pull request #2780 from chrislusf/dependabot/go_modules/go.etcd.io/etcd/client/v3-3.5.2" 
This reverts commit d1a6bd1cc6, reversing
changes made to a644b7236a.
 2022-03-21 22:54:00 -07:00
chrislu 2e23162188 Revert "Merge pull request #2778 from chrislusf/dependabot/go_modules/cloud.google.com/go/pubsub-1.19.0" 
This reverts commit 22aca43b26, reversing
changes made to d1a6bd1cc6.
 2022-03-21 22:53:53 -07:00
chrislu c8787d3e9a Revert "Bump github.com/spf13/viper from 1.4.0 to 1.10.1" 
This reverts commit c3fe1654b9.
 2022-03-21 22:53:38 -07:00
chrislu 8cfcb9fe9f Revert "Merge branch 'master' into dependabot/go_modules/github.com/spf13/viper-1.10.1" 
This reverts commit 5999099ed4, reversing
changes made to c3fe1654b9.
 2022-03-21 22:53:01 -07:00
chrislu af4f345b0c Revert "Merge pull request #2777 from chrislusf/dependabot/go_modules/github.com/spf13/viper-1.10.1" 
This reverts commit 8573798a8c, reversing
changes made to 087def339f.
 2022-03-21 22:52:39 -07:00
chrislu 4e2388e1b5 mount: set file size if it is only on remote gateway 2022-03-21 02:09:54 -07:00
chrislu 8f0410af2c 2.95 2022-03-21 01:47:03 -07:00
chrislu 24541fc7ec minor 2022-03-21 00:43:47 -07:00
chrislu ae558fa073 log reasons volumes became unwritable 2022-03-21 00:41:44 -07:00
chrislu 57c6eddd22 avoid possible deadlock if volume layout is used in some logs 2022-03-21 00:04:01 -07:00
chrislu 581c93d970 change to config_dir, to be consistent with "weed scaffold -config" 
fix https://github.com/chrislusf/seaweedfs/issues/2753
 2022-03-19 00:24:52 -07:00
chrislu b75c6dcff5 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-19 00:22:52 -07:00
chrislu 3da2b83b38 Added a "-conf_dir" option to customize *.toml configuration file directory. 
fix https://github.com/chrislusf/seaweedfs/issues/2753
 2022-03-19 00:22:47 -07:00
chrislu 2824940ecf Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-17 16:54:30 -07:00
chrislu f247cab5cd skip localhost if bound to all interfaces already 0.0.0.0 or 127.0.0.1 2022-03-17 16:54:29 -07:00
chrislu 6886167d5f minor optimization 2022-03-17 00:03:28 -07:00
chrislu 7542fd7f4d mount: optimize a bit when writing files 2022-03-17 00:02:38 -07:00
chrislu 4042fdf3bb rename to skipCheckParentDir 
related to https://github.com/chrislusf/seaweedfs/pull/2761

It's better to default to false.
 2022-03-16 23:55:31 -07:00
chrislu b5b97a4799 go 1.18 2022-03-16 01:35:12 -07:00
chrislu ed818c90a9 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-15 22:28:21 -07:00
chrislu 3639cad69c master, filer, s3: also listen to "localhost" in addition to specific ip address 
related to https://github.com/chrislusf/seaweedfs/issues/1937
 2022-03-15 22:28:18 -07:00
chrislu fbc9f0eb64 minor 2022-03-14 03:19:16 -07:00
chrislu 2eda3a686f 2.94 2022-03-14 00:55:01 -07:00
chrislu bd5c5586b5 generate inode via path and time 2022-03-14 00:03:29 -07:00
chrislu 5cba8e51c5 refactor 2022-03-13 18:34:57 -07:00
chrislu f2f68f675e write to disk during random writes, limiting total disk spaces used 2022-03-13 18:17:35 -07:00
chrislu 2f4cd20f90 tests skip reader pattern monitoring 2022-03-13 18:15:53 -07:00
chrislu 53513475bf mount: add back random read support 
avoid too much memory used also
 2022-03-13 01:38:52 -08:00
chrislu f70c1e449b add useful doc link 2022-03-13 00:14:50 -08:00
chrislu b20ddc57a7 mount: return open status 2022-03-12 22:38:14 -08:00
chrislu b40d252761 mount: chmod for root 2022-03-12 12:10:56 -08:00
chrislu 3a6eb8ca5f default bind to one ip address 
fix https://github.com/chrislusf/seaweedfs/issues/1937
 2022-03-11 14:02:39 -08:00
chrislu 197ade6aeb Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-09 22:26:55 -08:00
chrislu 011a41b561 add back writes to swap file when too many in memory chunks are used. 2022-03-09 22:26:51 -08:00
chrislu e2b07737da Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-08 23:02:33 -08:00
chrislu dc204dd137 fix nil entry 
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x40 pc=0x1d340b4]

goroutine 130523 [running]:
github.com/chrislusf/seaweedfs/weed/filer.FileSize(...)
        /code/seaweedfs/weed/filer/filechunks.go:26
github.com/chrislusf/seaweedfs/weed/mount.(*WFS).Lookup(0xc000866d80, 0x1, 0xc002897f40, {0xc004b00980, 0x39}, 0x1ec19e0)
        /code/seaweedfs/weed/mount/weedfs_dir_lookup.go:59 +0x654
github.com/hanwen/go-fuse/v2/fuse.doLookup(0xc00033c000, 0xc00033c000)
        /code/go/pkg/mod/github.com/hanwen/go-fuse/v2@v2.1.0/fuse/opcode.go:333 +0x6b
github.com/hanwen/go-fuse/v2/fuse.(*Server).handleRequest(0xc000ab2420, 0xc00033c000)
        /code/go/pkg/mod/github.com/hanwen/go-fuse/v2@v2.1.0/fuse/server.go:483 +0x1f3
github.com/hanwen/go-fuse/v2/fuse.(*Server).loop(0xc000ab2420, 0x0)
        /code/go/pkg/mod/github.com/hanwen/go-fuse/v2@v2.1.0/fuse/server.go:456 +0x110
created by github.com/hanwen/go-fuse/v2/fuse.(*Server).readRequest
        /code/go/pkg/mod/github.com/hanwen/go-fuse/v2@v2.1.0/fuse/server.go:323 +0x534
 2022-03-08 23:02:30 -08:00
chrislu 3aeee3d748 ensure releasing file handle 2022-03-07 14:01:24 -08:00
chrislu 8136384473 remove debug message 2022-03-07 11:22:26 -08:00
chrislu da3d330616 s3 and filer transport using unix domain socket instead of tcp 2022-03-07 02:00:14 -08:00
chrislu 0cb17b45b1 refactoring 2022-03-07 01:59:01 -08:00
chrislu 6d3db4445b buffer for all range requests 2022-03-07 01:56:47 -08:00
chrislu f3bcbeb60a a little optimization 2022-03-07 00:24:59 -08:00
chrislu f7ee60996c Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-07 00:08:09 -08:00
chrislu 6f3ec989a7 fix manifest batch size 2022-03-07 00:07:53 -08:00
chrislu bb0b784544 minor 2022-03-07 00:04:59 -08:00
chrislu 0ba4e4cd23 2.93 2022-03-06 18:54:12 -08:00
chrislu 46a28b8819 mount: adjust disk space based on quota 2022-03-06 17:22:49 -08:00
chrislu ede6ce44c6 fix test 2022-03-06 17:09:55 -08:00
chrislu 21ef152423 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-03-06 17:04:24 -08:00
chrislu f3442e36e6 mount: quota adjust error type to be syscall.ENOSPC 2022-03-06 17:04:21 -08:00
chrislu c7e8ac18f0 mount: quota for one mounted collection 
related to https://github.com/seaweedfs/seaweedfs-csi-driver/issues/48
 2022-03-06 02:44:40 -08:00
chrislu b7c992f410 add flag to enforce quota 2022-03-05 22:10:43 -08:00
chrislu f1713c96ae avoid possible runtime error: index out of range [0] with length 0 2022-03-05 21:14:31 -08:00
chrislu da76af187f mount: avoid possible index out of bounds error 2022-03-04 22:36:01 -08:00
chrislu 6e49e75a5b use logical number of files and sizes for statistics and quota 2022-03-04 18:47:44 -08:00
chrislu f51e20028a mount: avoid comma in mount options 
fix https://github.com/chrislusf/seaweedfs/issues/2719
 2022-03-03 03:42:29 -08:00
chrislu dc0f48682c unused 2022-03-03 03:41:35 -08:00
chrislu 28b8974a3a mount: fix directory pagination when using midnight commander 2022-03-03 02:59:31 -08:00
chrislu a96d4254e9 filer, s3, volume server: a bit memory optimization 2022-03-02 20:15:28 -08:00
chrislu 6fbbc78574 stream reading a whole chunk 2022-03-02 13:50:46 -08:00
chrislu 784583afc6 avoid pool memory allocation if too large 2022-03-02 13:50:28 -08:00
chrislu ba14307319 2.92 2022-02-28 15:22:19 -08:00
chrislu fcf3714443 mount: add back support for filer.path 2022-02-28 12:16:53 -08:00