Commit Graph
100 Commits
Author SHA1 Message Date
chrislu 03f18e43df clean up logs 2024-03-21 23:30:49 -07:00
chrislu 26e24db721 adjust log level 2024-03-21 23:27:19 -07:00
chrislu 5c0fcae039 clean up logs 2024-03-21 23:24:18 -07:00
chrislu 407a52fc93 adjust log level 2024-03-21 23:23:26 -07:00
chrislu 8b18dd940f Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-03-21 08:07:58 -07:00
chrislu 50023fe1cf adjust log level 2024-03-21 08:07:56 -07:00
chrislu a1816d21e9 fix compilation 2024-03-19 09:09:14 -07:00
chrislu ca042bd067 simplify 2024-03-17 01:01:45 -07:00
chrislu 4dce1e9d29 Revert "remove github.com/golang/protobuf/proto"
This reverts commit 1516e0249f.
2024-03-17 01:00:43 -07:00
chrislu a8b73296d7 fix test3 2024-03-16 23:53:46 -07:00
chrislu 3c559dc294 fix test2 2024-03-16 23:48:31 -07:00
chrislu ea2601799c fix test 2024-03-16 23:22:17 -07:00
chrislu 1516e0249f remove github.com/golang/protobuf/proto 2024-03-16 23:18:11 -07:00
chrislu b74e8082ba 3.64 2024-03-16 11:46:40 -07:00
chrislu 6a61b54f29 Merge branch 'mq-subscribe' 2024-03-16 11:42:23 -07:00
chrislu 27bb38228b only broad cast when there are waiting threads 2024-03-16 11:38:27 -07:00
chrislu 054d0b3487 wait for data 2024-03-16 11:14:14 -07:00
chrislu f8957b84c1 rename to LastTsNs 2024-03-16 10:52:47 -07:00
chrislu 529fa8c4c8 go fmt 2024-03-16 10:51:47 -07:00
chrislu 059df3957d rename to lastFlushDataTime 2024-03-16 10:51:16 -07:00
chrislu 1b5c547cfe logs 2024-03-15 21:08:57 -07:00
chrislu 55714f54ab local partition is generated or not 2024-03-15 21:08:42 -07:00
chrislu 56ce040ab6 log errors 2024-03-15 21:05:40 -07:00
chrislu 549455c30d streaming mode 2024-03-15 21:05:24 -07:00
chrislu f653838f34 follower receive a hello message before actual data
the leader can ensure the follower has connected
2024-03-15 20:36:01 -07:00
chrislu 64a32730a2 add size() 2024-03-15 20:34:39 -07:00
chrislu 6f615c62ae Merge branch 'master' into mq-subscribe 2024-03-12 09:19:06 -07:00
chrislu 604091a480 use stopChan to close previous filer peer meta subscription instances 2024-03-12 09:18:54 -07:00
chrislu 1efa502dbb go fmt 2024-03-12 09:17:20 -07:00
chrislu 6f75a0af55 ask follower to follow 2024-03-10 14:34:28 -07:00
chrislu c1a5952009 rename 2024-03-09 12:57:01 -08:00
chrislu e7823ee967 retry connecting to broker leader 2024-03-09 12:56:49 -08:00
chrislu 3b28433cb1 change LogBuffer visibility in LocalPartition 2024-03-07 10:57:04 -08:00
chrislu 28f8f33d6a include key in LogEntry 2024-03-07 10:53:30 -08:00
chrislu 34f2b600ac each log function adds a "done" return parameter 2024-03-07 10:50:09 -08:00
chrislu 62397f2371 adjust error 2024-03-07 10:47:50 -08:00
chrislu 832b60c13f pass errors 2024-03-07 10:47:06 -08:00
chrislu 49869eec83 edge cases for broker assignment 2024-03-07 10:45:38 -08:00
chrislu 33ab6cfcf7 adjust error 2024-03-07 10:44:09 -08:00
chrislu 8f79bb3987 Merge branch 'master' into mq-subscribe 2024-03-07 10:42:29 -08:00
chrislu b544a69550 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-03-07 10:42:15 -08:00
chrislu 5c0f01c0eb purge cluster id 2024-03-07 10:42:12 -08:00
chrislu fe03b1b522 handle single broker case 2024-03-01 05:59:40 -08:00
chrislu 50c5dd7313 test low active brokers 2024-02-29 20:50:57 -08:00
chrislu 7598922b41 assign followers 2024-02-29 14:51:06 -08:00
chrislu 7e443ef0a1 latest protoc-gen-go 2024-02-29 10:06:23 -08:00
chrislu ead27a4f59 publish init add followers 2024-02-29 09:39:12 -08:00
chrislu 1b4484bf0a go fmt 2024-02-29 09:38:52 -08:00
chrislu 2a7028373d Merge branch 'master' into mq-subscribe 2024-02-29 06:22:39 -08:00
chrislu 76ae39a363 Merge branch 'master' into mq-subscribe 2024-02-26 07:03:09 -08:00
chrislu 54d7748a4a 3.63 2024-02-25 22:17:28 -08:00
chrislu a52ce076fc Merge branch 'master' into mq-subscribe 2024-02-25 08:00:37 -08:00
chrislu 7c45992c79 when verifyNeedleIntegrity, do not truncate files
related to https://github.com/seaweedfs/seaweedfs/pull/5259
2024-02-24 02:37:03 -08:00
chrislu bf0899cbf4 adjust build tags for full 2024-02-24 01:55:18 -08:00
Chris Lu 2ad363d984 upgrade go, rocksdb 2024-02-07 00:41:03 -08:00
Chris Lu 16b4f9d9ab subscriber find broker leader first 2024-02-05 23:14:25 -08:00
Chris Lu e27deed4bc upgrade protoc 2024-02-05 18:39:08 -08:00
Chris Lu 656b78d1af proxy to broker leader 2024-02-05 18:00:50 -08:00
Chris Lu 90fcde0e26 report EOF error 2024-02-05 17:47:34 -08:00
Chris Lu 07028a4864 minor 2024-02-05 17:30:20 -08:00
Chris Lu fa72761bb8 fix on finding lock owner 2024-02-05 17:30:14 -08:00
Chris Lu c471265837 build with pub sub clients for testing 2024-02-05 16:47:11 -08:00
Chris Lu 4dc6681833 proxy requests to lock owner 2024-02-05 16:46:40 -08:00
Chris Lu 0d74ac9224 fix divide by zero 2024-02-04 13:38:00 -08:00
Chris Lu f9131de43f fix lock TTL 2024-02-04 12:47:21 -08:00
Chris Lu 44b49bec99 less verbose 2024-02-04 12:47:07 -08:00
Chris Lu 53612b770c Merge branch 'master' into mq-subscribe 2024-02-04 10:44:01 -08:00
Chris Lu 56df44845f fix when two consecutive chunks with the same modified_ts_ns
fix https://github.com/seaweedfs/seaweedfs/issues/5276
2024-02-04 09:22:24 -08:00
Chris Lu 0a12301b3d avoid too large expiration time 2024-02-04 09:20:21 -08:00
Chris Lu 1b5ba4190c avoid timestamp overflow 2024-02-03 13:45:59 -08:00
chrislu d41792461c lock returns host and owner 2024-02-02 15:54:57 -08:00
chrislu d30150dde1 use a short-lived lock 2024-02-01 23:01:44 -08:00
chrislu 0aed16a9c4 add make brokers 2024-01-31 21:31:10 -08:00
chrislu c1bb76d709 fix nil error 2024-01-30 08:21:42 -08:00
chrislu ac50d8a822 re-lock if the lock owner is not found 2024-01-29 22:46:23 -08:00
chrislu 0b2e5ddc7c wait 3 seconds before shutting down publish client, to wait for all messages to be received 2024-01-28 22:04:42 -08:00
chrislu 545d5fbdf6 unused code 2024-01-28 22:03:13 -08:00
chrislu a507069d19 lock for creating local partition 2024-01-28 15:55:26 -08:00
chrislu 9e6ea80dff read existing topic conf 2024-01-28 14:27:52 -08:00
chrislu a297247137 wait for each publish clients 2024-01-28 14:27:32 -08:00
chrislu b6c5e57c30 read will block if no items 2024-01-28 13:10:34 -08:00
chrislu 0bf5424a2e adjust visibility 2024-01-28 13:09:30 -08:00
chrislu dedfd31dfb refactor 2024-01-28 12:30:08 -08:00
chrislu cbf750a31f refactor 2024-01-28 12:23:20 -08:00
chrislu b51dfe2bff wait for publishing clients 2024-01-28 12:06:58 -08:00
chrislu f8c55f101e clean up 2024-01-28 12:06:30 -08:00
chrislu d40225ecd2 return the lookup results 2024-01-28 12:05:44 -08:00
chrislu 841fafd0a8 publish to input buffer
currently, the input buffer may not exist when start to publish
2024-01-27 23:43:22 -08:00
chrislu 5dc1362bdc close the input 2024-01-27 16:12:49 -08:00
chrislu fa835c9319 Update buffered_queue_test.go 2024-01-27 14:46:12 -08:00
Chris Lu b6de35cdb2 moved. there are some deadlock. WIP 2024-01-27 13:51:19 -08:00
chrislu 91af1f3069 schedule jobs 2024-01-26 14:09:57 -08:00
chrislu 08c5fba825 adds a buffered queue 2024-01-25 20:22:41 -08:00
chrislu cb50b720fd Revert "Fix weed fix"
This reverts commit 6c1ce18541.
2024-01-25 08:09:36 -08:00
chrislu 025f8eb37b return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
2024-01-23 19:48:42 -08:00
chrislu d4e66cc140 return dir assign counter
fix https://github.com/seaweedfs/seaweedfs/issues/5231
2024-01-23 19:47:31 -08:00
chrislu a8ddbf9ed2 Merge branch 'master' into mq-subscribe 2024-01-23 19:41:16 -08:00
chrislu 49fcb48e04 same logic as grpc assign
fix https://github.com/seaweedfs/seaweedfs/issues/5213
2024-01-23 19:39:59 -08:00
chrislu 7c1ad109ef Merge branch 'master' into mq-subscribe 2024-01-22 13:23:12 -08:00
chrislu 439377b7a0 adjust exception text 2024-01-22 12:53:44 -08:00