Github-Mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-09-11 09:00:45 +02:00
Code Issues Packages Projects Releases Wiki Activity
11,111 Commits 176 Branches 359 Tags
6232041c64e4c79a2f2a2853e6b36adfe3fa9df7
Commit Graph
1646 Commits
Author SHA1 Message Date
wyang a7973ed7d1 fix deadlock hang when broadcast to clients (#6184) 
fix deadlock when broadcast to clients

when master thransfer leader, the old master will disconnect with all
filers and volumeServers, if the cluster is a big , the broadcast
messages may be more big than the max of the channel len 100, then if the
KeepConnect was not listen on the channel in disconnect, it will
deadlock. and the whole cluster will not serve!
 2024-11-03 23:20:48 -08:00
BruceandChris Lu 0060a2cf9c Fix 6181/6182 (#6183) 
* set larger buf size for LogBuffer

* jump to next day when no more entry found

* Update weed/filer/filer_notify_read.go

---------

Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
 2024-10-31 08:40:05 -07:00
chrislu ad6240f066 fix parameter 2024-10-30 20:30:51 -07:00
chrislu 8802843511 pass in bytes buffer to avoid possible race condition 
related to https://github.com/seaweedfs/seaweedfs/issues/6180
 2024-10-30 09:31:22 -07:00
chrislu 3feb66d0a1 adding more debug message 
related to https://github.com/seaweedfs/seaweedfs/issues/6180
 2024-10-30 09:16:40 -07:00
chrislu ae5bd0667a rename proto field from DestroyTime to expire_at_sec 
For TTL volume converted into EC volume, this change may leave the volumes staying.
 2024-10-24 21:35:11 -07:00
Guang Jiong LouandChris Lu 9369a88c5c stop renaming worm files (#6154) 
* stop renaming worm file

Signed-off-by: lou <alex1988@outlook.com>

* update after review

Signed-off-by: lou <alex1988@outlook.com>

* Update weed/server/filer_server_handlers_write.go

---------

Signed-off-by: lou <alex1988@outlook.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
 2024-10-22 08:46:18 -07:00
Guang Jiong Lou 54b91ba2b2 fix permission check in put request (#6142) 2024-10-18 07:00:45 -07:00
steve.wei cfbe45c765 feat: add in-flight metric for s3/file/volume-server (#6120) 2024-10-14 12:10:05 -07:00
chrislu 6564ceda91 skip resource heavy commands from running on master nodes 2024-09-29 10:51:17 -07:00
coffeecloudgit dad3a26fb6 Update volume_grpc_erasure_coding.go , fix no space left bug (#6077) 2024-09-27 12:04:27 -07:00
coffeecloudgit 6cbce110d5 Update volume_grpc_erasure_coding.go (#6073) 2024-09-27 07:02:30 -07:00
Neo aa61824442 master:fix empty target in Build() (#6069) 2024-09-27 00:45:18 -07:00
LHHDZ 4dc33cc143 fix unclaimed spaces calculation when volumePreallocate is enabled (#6063) 
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.

Signed-off-by: LHHDZ <shichanglin5@qq.com>
 2024-09-24 23:04:18 -07:00
Max Denushev d056c0ddf2 fix(volume): don't persist RO state in specific cases (#6058) 
* fix(volume): don't persist RO state in specific cases

* fix(volume): writable always persist
 2024-09-24 16:15:54 -07:00
zemulandzemul 028ebb1d0d Feat:merge small chunk (#6049) 
* fix:mount deadlock

* feat: merge small chunk

* adjust MergeChunkMinCount

* fix

---------

Co-authored-by: zemul <zhouzemiao@ihuman.com>
 2024-09-23 08:51:03 -07:00
Konstantin Lebedev 2b13d2c083 [filer] fix return 204 for DELETE on entry not found (#6023) 
fix return 204 for DELETE on entry not found
 2024-09-16 23:11:03 -07:00
Guang Jiong Lou 6c986e9d70 improve worm support (#5983) 
* improve worm support

Signed-off-by: lou <alex1988@outlook.com>

* worm mode in filer

Signed-off-by: lou <alex1988@outlook.com>

* update after review

Signed-off-by: lou <alex1988@outlook.com>

* update after review

Signed-off-by: lou <alex1988@outlook.com>

* move to fs configure

Signed-off-by: lou <alex1988@outlook.com>

* remove flag

Signed-off-by: lou <alex1988@outlook.com>

* update after review

Signed-off-by: lou <alex1988@outlook.com>

* support worm hardlink

Signed-off-by: lou <alex1988@outlook.com>

* update after review

Signed-off-by: lou <alex1988@outlook.com>

* typo

Signed-off-by: lou <alex1988@outlook.com>

* sync filer conf

Signed-off-by: lou <alex1988@outlook.com>

---------

Signed-off-by: lou <alex1988@outlook.com>
 2024-09-16 21:02:21 -07:00
dsdandlevi 151f2ff7a9 prevent dead loop for followers of master node (#6007) 
* prevent dead loop for followers of master node

* fix comments

---------

Co-authored-by: levi <344887649@foxmail.com>
 2024-09-11 10:24:52 -07:00
Konstantin Lebedev 34bbaa2cdd [master] process grow request with must grow (#5999) 
process grow request with must grow
 2024-09-09 23:45:02 -07:00
Konstantin Lebedev 15965f7c54 [shell] fix volume grow in shell (#5992) 
* fix volume grow in shell

* revert add Async

* check available volume space

* create a VolumeGrowRequest and remove unnecessary fields
 2024-09-09 11:42:56 -07:00
chrislu 43d9f68219 more consistent server header for s3 apis 2024-09-09 09:07:58 -07:00
chrislu ff3d46637d better logging for volume growth 2024-09-07 12:38:34 -07:00
chrislu accba3070a refactor 2024-09-07 11:54:22 -07:00
Eugeniy E. Mikhailov d6b0e0ff1c Remove "Content-Length" header if http.Error is issued (#5981) 2024-09-05 17:31:28 -07:00
Konstantin Lebedev 67a252ee8a [master] refactor func ShouldGrowVolumes (#5884) 2024-09-04 08:16:44 -07:00
chrislu 18afdb15b6 Revert "weed mount, weed dav add option to force cache" 
This reverts commit 7367b976b0.
 2024-09-04 01:38:29 -07:00
chrislu 7367b976b0 weed mount, weed dav add option to force cache 2024-09-04 01:19:14 -07:00
chrislu 8d5a6d7e74 fix for spreading ec shards 2024-09-03 22:30:11 -07:00
chrislu 8e4bffc66b copy ec shards to disks already having ec volumes 
fix https://github.com/seaweedfs/seaweedfs/issues/5615
 2024-09-03 21:19:10 -07:00
chrislu 8679870008 fix typo 2024-08-30 14:51:55 -07:00
chrislu 22d5d2ea96 adjust warning log 2024-08-30 14:51:42 -07:00
chrislu a4b25a642d math/rand => math/rand/v2 2024-08-29 09:52:21 -07:00
chrislu 3b7bb62e38 logs on error 2024-08-26 09:09:11 -07:00
chrislu 4463296811 add parallel vacuuming 2024-08-21 22:53:54 -07:00
zemulandzemul 95bae91ca7 Fix get dir metadata (#5923) 
* fix:mount deadlock

* feat: query dir metadata

* feat: query dir metadata

---------

Co-authored-by: zemul <zhouzemiao@ihuman.com>
 2024-08-21 11:01:18 -07:00
Riccardo Bertossa 6fe8639504 add http endpoint to get the size of a collection (#5910) 2024-08-19 07:44:45 -07:00
augustazz db833abfa2 fix ec volume lookup data sync (#5900) 2024-08-16 06:08:33 -07:00
augustazzandxuwenfeng 0b00706454 EC volume supports expiration and displays expiration message when executing volume.list (#5895) 
* ec volume expire

* volume.list show DestroyTime

* comments

* code optimization

---------

Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
 2024-08-16 00:20:00 -07:00
chrislu fdf7193ae7 rename 2024-08-13 13:59:24 -07:00
chrislu 07f4998188 add dat file size into vif for EC 2024-08-13 13:56:00 -07:00
Konstantin Lebedev 3e6ca6e706 [webdav] status code 500 if internal error from filer (#5865) 2024-08-06 07:39:52 -07:00
chrislu 4fee496b49 conditional delete 2024-08-01 13:00:54 -07:00
Konstantin Lebedev b2ffcdaab2 [master] do sync grow request only if absolutely necessary (#5821) 
* do sync grow request only if absolutely necessary
https://github.com/seaweedfs/seaweedfs/pull/5819

* remove check VolumeGrowStrategy Threshold on PickForWrite

* fix fmt.Errorf
 2024-07-30 13:21:35 -07:00
Jiffs Maverick c8506609d8 [filer] Added a version to the title of Filer UI (#5836) 
Added a version to the title of Filer UI
 2024-07-29 14:07:12 -07:00
wyangandYang Wang 4b1f539ab8 fix allocate reduplicated volumeId to different volume (#5811) 
* fix allocate reduplicated volumeId to different volume

* only check barrier when read

---------

Co-authored-by: Yang Wang <yangwang@weride.ai>
 2024-07-26 21:48:36 -07:00
chrislu e2a07d11d5 Revert "Check ShouldGrowVolumes before returning error in assign. (#5819)" 
This reverts commit 98d66338d0333cd955f7840c64ef95e3c4807a17.
 2024-07-26 11:21:50 -07:00
wyangandYang Wang 0581ce6096 fix delete chunk failed if volumeSever specified grpc.port (#5820) 
Co-authored-by: Yang Wang <yangwang@weride.ai>
 2024-07-26 11:14:19 -07:00
chrislu ec9455dab7 same change as #5819 
follow up with https://github.com/seaweedfs/seaweedfs/pull/5819
 2024-07-26 11:06:47 -07:00
Ruoxi d15966ae8e Check ShouldGrowVolumes before returning error in assign. (#5819) 2024-07-26 11:04:38 -07:00