Github-Mirror/seaweedfs
1
0 Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-11-04 11:07:35 +01:00
Code Issues Packages Projects Releases Wiki Activity
10,382 Commits 227 Branches 365 Tags
c9df613b6bfb7e22e4e596151300aefc56ac909f
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
chrislu c9df613b6b add publisher name for debugging 2024-03-31 00:19:16 -07:00
chrislu ca4f89a6f6 simplify 2024-03-30 20:37:57 -07:00
chrislu 0d55bddc75 logs 2024-03-30 20:37:46 -07:00
chrislu 13b7c7b366 Merge branch 'master' into mq-subscribe 2024-03-27 23:57:00 -07:00
chrislu e3c8be7f89 LocalPartition shutdown 2024-03-27 23:55:06 -07:00
chrislu ab9fc0ad70 simplify 2024-03-27 23:42:19 -07:00
chrislu 7463058299 change visibility 2024-03-27 23:11:35 -07:00
chrislu dab5454332 publish and send to follower 2024-03-27 23:10:24 -07:00
chrislu f249f831b1 MaybeShutdownLocalPartition refactor 2024-03-27 23:02:51 -07:00
chrislu 2a0ab7e90d fix 2024-03-27 22:59:50 -07:00
chrislu 059a120708 refactor 2024-03-27 22:58:20 -07:00
chrislu 7d87c1d2bb refactor 2024-03-27 22:48:37 -07:00
chrislu 6aa804b368 lock instead of RLock, to prevent racing condition 
https://github.com/seaweedfs/seaweedfs/discussions/5432#discussioncomment-8933608
 2024-03-27 16:05:11 -07:00
chrislu 5cc94a05b9 separate goroutine to send ack to publisher 2024-03-27 10:27:08 -07:00
chrislu 17806cde2a separate context 
If using the same context, the downstream grpc would be cancelled when the parent grpc is cancelled.
 2024-03-27 10:24:57 -07:00
chrislu f67c8309d8 rename 2024-03-26 21:52:12 -07:00
chrislu 7d69552974 log server list 2024-03-26 21:51:28 -07:00
chrislu 36fec34c47 print only adapted url 
fix https://github.com/seaweedfs/seaweedfs/issues/5424
 2024-03-25 12:50:43 -07:00
chrislu 707ff536a3 Merge branch 'master' into mq-subscribe 2024-03-25 11:21:19 -07:00
chrislu aed6fdffd2 fix nil volume data backend 
fix https://github.com/seaweedfs/seaweedfs/issues/5417
 2024-03-25 08:19:31 -07:00
chrislu d6a066495b adjust logs 2024-03-25 08:15:47 -07:00
chrislu 1b1b96ea1e close local partition if no more publishers and subscribers 2024-03-24 21:10:02 -07:00
chrislu 4f5c4c3388 refactor 2024-03-24 13:07:51 -07:00
chrislu d558a58946 refactor 2024-03-24 13:04:59 -07:00
chrislu 205d2285f3 setup follower by publisher 
* the subscriber would getOrGen a local partition and wait
* the publisher would getOrGen a local partition. If localPartition follower is not setup, and init message has follower info, it would create followers based on init.Messages.
 2024-03-24 12:57:09 -07:00
chrislu ac13644fc9 Merge branch 'master' into mq-subscribe 2024-03-21 23:31:49 -07:00
chrislu 03f18e43df clean up logs 2024-03-21 23:30:49 -07:00
chrislu b5a6f10612 Merge branch 'master' into mq-subscribe 2024-03-21 23:27:41 -07:00
chrislu 26e24db721 adjust log level 2024-03-21 23:27:19 -07:00
chrislu 36a3301e0c Merge branch 'master' into mq-subscribe 2024-03-21 23:24:28 -07:00
chrislu 5c0fcae039 clean up logs 2024-03-21 23:24:18 -07:00
chrislu 407a52fc93 adjust log level 2024-03-21 23:23:26 -07:00
chrislu da31e9b939 correctly wait for the publisher to finish 2024-03-21 09:08:53 -07:00
chrislu e641d49f9f Merge branch 'master' into mq-subscribe 2024-03-21 08:22:14 -07:00
chrislu 8b18dd940f Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-03-21 08:07:58 -07:00
chrislu 50023fe1cf adjust log level 2024-03-21 08:07:56 -07:00
chrislu 7003ce7425 publisher is able to fully send data and receive acks 
still needs to close the pipes cleanly
 2024-03-20 12:25:40 -07:00
chrislu 96149cbf7f Merge branch 'master' into mq-subscribe 2024-03-19 09:14:27 -07:00
chrislu a1816d21e9 fix compilation 2024-03-19 09:09:14 -07:00
chrislu ad408a7d38 Merge branch 'master' into mq-subscribe 2024-03-19 08:58:09 -07:00
chrislu 516cba7053 remove FollowInMemoryMessages 2024-03-17 22:27:13 -07:00
chrislu 6ef3e6bcad logging 2024-03-17 22:24:20 -07:00
chrislu a375b2815e Merge branch 'master' into mq-subscribe 2024-03-17 11:46:55 -07:00
chrislu ca042bd067 simplify 2024-03-17 01:01:45 -07:00
chrislu 4dce1e9d29 Revert "remove github.com/golang/protobuf/proto" 
This reverts commit 1516e0249f.
 2024-03-17 01:00:43 -07:00
chrislu a8b73296d7 fix test3 2024-03-16 23:53:46 -07:00
chrislu 3c559dc294 fix test2 2024-03-16 23:48:31 -07:00
chrislu ea2601799c fix test 2024-03-16 23:22:17 -07:00
chrislu 1516e0249f remove github.com/golang/protobuf/proto 2024-03-16 23:18:11 -07:00
chrislu 8e5068fd2f notify 2024-03-16 23:16:33 -07:00
chrislu aba934f0b5 adjust log level 2024-03-16 23:15:06 -07:00
chrislu 44ab42d03c unnecessary 2024-03-16 17:11:42 -07:00
chrislu 3f2dd8cc3e add follower id info 2024-03-16 17:11:18 -07:00
chrislu b74e8082ba 3.64 2024-03-16 11:46:40 -07:00
chrislu 6a61b54f29 Merge branch 'mq-subscribe' 2024-03-16 11:42:23 -07:00
chrislu 27bb38228b only broad cast when there are waiting threads 2024-03-16 11:38:27 -07:00
chrislu 054d0b3487 wait for data 2024-03-16 11:14:14 -07:00
chrislu f8957b84c1 rename to LastTsNs 2024-03-16 10:52:47 -07:00
chrislu 529fa8c4c8 go fmt 2024-03-16 10:51:47 -07:00
chrislu 059df3957d rename to lastFlushDataTime 2024-03-16 10:51:16 -07:00
chrislu 1b5c547cfe logs 2024-03-15 21:08:57 -07:00
chrislu 55714f54ab local partition is generated or not 2024-03-15 21:08:42 -07:00
chrislu 56ce040ab6 log errors 2024-03-15 21:05:40 -07:00
chrislu 549455c30d streaming mode 2024-03-15 21:05:24 -07:00
chrislu f653838f34 follower receive a hello message before actual data 
the leader can ensure the follower has connected
 2024-03-15 20:36:01 -07:00
chrislu 64a32730a2 add size() 2024-03-15 20:34:39 -07:00
chrislu 6f615c62ae Merge branch 'master' into mq-subscribe 2024-03-12 09:19:06 -07:00
chrislu 604091a480 use stopChan to close previous filer peer meta subscription instances 2024-03-12 09:18:54 -07:00
chrislu 1efa502dbb go fmt 2024-03-12 09:17:20 -07:00
chrislu 6f75a0af55 ask follower to follow 2024-03-10 14:34:28 -07:00
chrislu c1a5952009 rename 2024-03-09 12:57:01 -08:00
chrislu e7823ee967 retry connecting to broker leader 2024-03-09 12:56:49 -08:00
chrislu 3b28433cb1 change LogBuffer visibility in LocalPartition 2024-03-07 10:57:04 -08:00
chrislu 28f8f33d6a include key in LogEntry 2024-03-07 10:53:30 -08:00
chrislu 34f2b600ac each log function adds a "done" return parameter 2024-03-07 10:50:09 -08:00
chrislu 62397f2371 adjust error 2024-03-07 10:47:50 -08:00
chrislu 832b60c13f pass errors 2024-03-07 10:47:06 -08:00
chrislu 49869eec83 edge cases for broker assignment 2024-03-07 10:45:38 -08:00
chrislu 33ab6cfcf7 adjust error 2024-03-07 10:44:09 -08:00
chrislu 8f79bb3987 Merge branch 'master' into mq-subscribe 2024-03-07 10:42:29 -08:00
chrislu b544a69550 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-03-07 10:42:15 -08:00
chrislu 5c0f01c0eb purge cluster id 2024-03-07 10:42:12 -08:00
chrislu fe03b1b522 handle single broker case 2024-03-01 05:59:40 -08:00
chrislu 50c5dd7313 test low active brokers 2024-02-29 20:50:57 -08:00
chrislu 7598922b41 assign followers 2024-02-29 14:51:06 -08:00
chrislu 7e443ef0a1 latest protoc-gen-go 2024-02-29 10:06:23 -08:00
chrislu ead27a4f59 publish init add followers 2024-02-29 09:39:12 -08:00
chrislu 1b4484bf0a go fmt 2024-02-29 09:38:52 -08:00
chrislu 2a7028373d Merge branch 'master' into mq-subscribe 2024-02-29 06:22:39 -08:00
chrislu 76ae39a363 Merge branch 'master' into mq-subscribe 2024-02-26 07:03:09 -08:00
chrislu 54d7748a4a 3.63 2024-02-25 22:17:28 -08:00
chrislu a52ce076fc Merge branch 'master' into mq-subscribe 2024-02-25 08:00:37 -08:00
chrislu 7c45992c79 when verifyNeedleIntegrity, do not truncate files 
related to https://github.com/seaweedfs/seaweedfs/pull/5259
 2024-02-24 02:37:03 -08:00
chrislu bf0899cbf4 adjust build tags for full 2024-02-24 01:55:18 -08:00
Chris Lu 2ad363d984 upgrade go, rocksdb 2024-02-07 00:41:03 -08:00
Chris Lu 16b4f9d9ab subscriber find broker leader first 2024-02-05 23:14:25 -08:00
Chris Lu e27deed4bc upgrade protoc 2024-02-05 18:39:08 -08:00
Chris Lu 656b78d1af proxy to broker leader 2024-02-05 18:00:50 -08:00
Chris Lu 90fcde0e26 report EOF error 2024-02-05 17:47:34 -08:00
Chris Lu 07028a4864 minor 2024-02-05 17:30:20 -08:00