Github-Mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-09-20 13:30:46 +02:00
Code Issues Packages Projects Releases Wiki Activity
12,097 Commits 181 Branches 360 Tags
a24c31de06093337cd31e42ed94de67ce1d5c95b
Commit Graph
7706 Commits
Author SHA1 Message Date
vadimartynov 914ff0e718 Replaced https.client.enabled with false in scaffold/security (#6320) 2024-12-05 10:39:28 -08:00
chrislu f3dde99796 adjust error message 2024-12-05 09:33:50 -08:00
Lisandro Pin 34cdbdd279 Share common parameters for EC re-balancing functions under a single struct. (#6319) 
TODO cleanup for https://github.com/seaweedfs/seaweedfs/discussions/6179.
 2024-12-05 09:00:46 -08:00
Lisandro Pin edef485333 Account for replication placement settings when balancing EC shards within the same rack. (#6317) 
* Account for replication placement settings when balancing EC shards within racks.

* Update help contents for `ec.balance`.

* Add a few more representative test cases for `pickEcNodeToBalanceShardsInto()`.
 2024-12-04 10:47:51 -08:00
Lisandro Pin 351efa134d Account for replication placement settings when balancing EC shards across racks. (#6316) 2024-12-04 09:00:55 -08:00
Konstantin Lebedev b65eb2ec45 [security] reload whiteList on http seerver (#6302) 
* reload whiteList

* white_list add to scaffold
 2024-12-02 10:38:10 -08:00
Lisandro Pin b2ba7d7408 Resolve replica placement for EC volumes from master server defaults. (#6303) 2024-12-02 08:44:07 -08:00
Lisandro Pin 9a741a61b1 Display details upon failures to re-balance EC shards racks. (#6299) 2024-11-28 08:42:41 -08:00
Lisandro Pin 559a1fd0f4 Improve EC shards rebalancing logic across nodes (#6297) 
* Improve EC shards rebalancing logic across nodes.

- Favor target nodes with less preexisting shards, to ensure a fair distribution.
- Randomize selection when multiple possible target nodes are available.
- Add logic to account for replication settings when selecting target nodes (currently disabled).

* Fix minor test typo.

* Clarify internal error messages for `pickEcNodeToBalanceShardsInto()`.
 2024-11-27 11:51:57 -08:00
steve.wei 88fa64a01a change comment for expect header (#6289) 
* remove case of expect

* Set the default value of the Expect header for compatibility.
 2024-11-26 08:35:41 -08:00
Konstantin Lebedev e2e97db917 [master] avoid timeout when assigning for main request with filter by DC or rack (#6291) 
* avoid timeout when assigning for main request with filter by DC or rack

https://github.com/seaweedfs/seaweedfs/issues/6290

* use constant NoWritableVolumes
 2024-11-26 08:33:31 -08:00
Konstantin Lebedev fec88e64eb [master] update LastLeaderChangeTime for hashicorp raft (#6292) 2024-11-26 08:02:45 -08:00
Trim21 d43fa07f06 use readable bytes size string in shell output (#6288) 2024-11-25 17:25:17 -08:00
Konstantin Lebedev 8836fa19b6 use ShouldGrowVolumesByDcAndRack (#6280) 2024-11-25 09:30:37 -08:00
Konstantin Lebedev 167b50be88 fix missing register master metric MasterPickForWriteErrorCounter (#6277) 2024-11-25 08:59:11 -08:00
Trim21 fd6c787c02 fix EcVolumes sorting in volume UI (#6275) 
* Update store_ec.go

* fix: EcVolume sorting not work

* use stdlib

* revert
 2024-11-23 22:43:08 -08:00
chrislu ccf1795e6f wait a bit before getting the next volume id if the leader is recently elected 2024-11-23 19:58:45 -08:00
chrislu 04081128a9 use math rand v2 2024-11-21 08:54:03 -08:00
chrislu 54204bc89b format error 2024-11-21 08:52:39 -08:00
Lisandro Pin ca499de1cb Improve EC shards rebalancing logic across racks (#6270) 
Improve EC shards rebalancing logic across racks.

  - Favor target shards with less preexisting shards, to ensure a fair distribution.
  - Randomize selection when multiple possible target shards are available.
  - Add logic to account for replication settings when selecting target shards (currently disabled).
 2024-11-21 08:46:24 -08:00
Numblgwandliguowei e56327e3b0 ExclusiveLocker only create one renew goroutine (#6269) 
Co-authored-by: liguowei <liguowei@xinye.com>
 2024-11-21 08:27:12 -08:00
Numblgwandliguowei aebf3952b7 filer sync: source path and exclude path support dir suffix (#6268) 
filer sync: source path and exclude paht support dir suffix

Co-authored-by: liguowei <liguowei@xinye.com>
 2024-11-21 08:25:12 -08:00
Konstantin Lebedev 7fa4e5c2a1 [master] Revert back automatic volume grow in case of compensate for crowded volumes (#6267) 
brought back the Automatic Volume Grow to compensate for crowded volumes
 2024-11-21 08:19:19 -08:00
Konstantin Lebedev a143c888e5 [shell] don't require lock when there are no changes for volume.fix.replication (#6266) 
* don't require lock when there are no changes

* revert takeAction
 2024-11-21 08:17:25 -08:00
Konstantin Lebedev a49d9e020c [master] avoid crowded more writable for auto grow (#6214) 
avoid crowded more writable
https://github.com/seaweedfs/seaweedfs/issues/6121
 2024-11-21 00:57:42 -08:00
chrislu 75f5afa571 fix compilation 2024-11-21 00:41:22 -08:00
chrislu 1c143cfcea display actual offset value 2024-11-21 00:38:03 -08:00
chrislu c9f3448692 ReadAt may return io.EOF t end of file 
related to https://github.com/seaweedfs/seaweedfs/issues/6219
 2024-11-21 00:37:38 -08:00
chrislu be09d08eb6 adjust error message 2024-11-20 23:49:01 -08:00
chrislu 6b2612690b consistent error message if auth is not setup 
fix https://github.com/seaweedfs/seaweedfs/issues/6262
 2024-11-20 23:11:18 -08:00
Konstantin Lebedev 254ed8897e [shell] add noLock param for volume.move (#6261) 2024-11-20 08:35:24 -08:00
chrislu 96f1a2e01a adjust error message 2024-11-19 14:16:06 -08:00
chrislu e28f55eb08 typo 2024-11-19 08:32:31 -08:00
chrislu 98f03862aa rename 2024-11-19 08:31:54 -08:00
chrislu 07cf8cf22d minor 2024-11-19 08:31:33 -08:00
Lisandro Pin 0d5393641e Unify usage of shell.EcNode.dc as DataCenterId. (#6258) 2024-11-19 06:33:18 -08:00
chrislu bc7650bd61 adds more info on skipped volumes 2024-11-18 18:25:44 -08:00
Lisandro Pin f2db746690 Introduce logic to resolve volume replica placement within EC rebalancing. (#6254) 
* Rename `command_ec_encode_test.go` to `command_ec_common_test.go`.

All tests defined in this file are now for `command_ec_common.go`.

* Minor code cleanups.

- Fix broken `ec.balance` test.
- Rework integer ceiling division to not use floats, which can introduce precision errors.

* Introduce logic to resolve volume replica placement within EC rebalancing.

This will be used to make rebalancing logic topology-aware.

* Give shell.EcNode.dc a dedicated DataCenterId type.
 2024-11-18 18:05:06 -08:00
chrislu 7b3c0e937f 3.80 2024-11-18 09:48:33 -08:00
zemulandzemul 6d3e38f439 Adjust threshold config (#6246) 
* fix:mount deadlock

* fix

---------

Co-authored-by: zemul <zhouzemiao@ihuman.com>
 2024-11-17 20:51:26 -08:00
Kevin Bulteel 4a0dc883cf Fix/parse upload filename (#6241) 
* fix: parse filename in PUT + refactor

* fix: master iu public url with http

* fix: better parsing and handle disposition header

* fix: take mime type from file extension if not set
 2024-11-15 11:25:18 -08:00
Max DenushevMax DenushevChris Lu
 		a5fe6e21bc feat(filer.backup): add ignore errors option (#6235) 
* feat(filer.backup): add ignore errors option

* feat(filer.backup): fix 404 error wrap

* feat(filer.backup): fix wrapping function

* feat(filer.backup): fix wrapping errors in genProcessFunction

* Update weed/command/filer_backup.go

* Update weed/command/filer_backup.go

* Update weed/command/filer_backup.go

---------

Co-authored-by: Max Denushev <denushev@tochka.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
 2024-11-14 08:40:55 -08:00
Eugeniy E. Mikhailov 3003c9e17e added backward compatible CRC check and extra explanatory comments (#6233) 2024-11-12 13:56:14 -08:00
Chris Lu 72b14a451e delete aborted ec shards from both source and target servers (#6221) 
fix https://github.com/seaweedfs/seaweedfs/issues/6205#issuecomment-2465004586
 2024-11-09 11:32:08 -08:00
chrislu 113c9ce6a8 remove the direct_io flag, as it is not well-supported on macOS 2024-11-07 14:18:59 -08:00
chrislu 88a1eee31c adjust logs 2024-11-07 13:00:12 -08:00
chrislu 62c4980754 add debug info 2024-11-06 11:59:03 -08:00
Konstantin Lebedev 9a5d3e7b31 [shell] add admin noLock for balance (#6209) 
add admin noLock for balance
 2024-11-05 19:09:22 -08:00
Bruce 15fc58bfd9 remove dup code for section.reader access (#6169) 2024-11-05 19:08:59 -08:00
chrislu 706d1a8e22 fix tests 2024-11-05 08:52:07 -08:00