Commit Graph
100 Commits
Author SHA1 Message Date
chrislu 364bb6c7b4 avoid ticker leak 2024-05-24 17:15:12 -07:00
chrislu ba98f02d02 go fmt 2024-05-23 08:25:16 -07:00
chrislu aba212dedd Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2024-05-20 11:03:58 -07:00
chrislu d218fe54fa go fmt 2024-05-20 11:03:56 -07:00
chrislu d3032d1e80 3.67 2024-05-07 08:47:30 -07:00
chrislu 1917f70f78 also delete parent folder if empty
fix https://github.com/seaweedfs/seaweedfs/issues/5567
2024-05-07 08:46:19 -07:00
chrislu 3682eb929f 3.66 2024-05-05 22:23:18 -07:00
chrislu fcedf97e94 fix test 2024-05-05 22:19:59 -07:00
chrislu dd1571b95b add some delay when starting filers, to simulate real production 2024-05-05 14:18:11 -07:00
chrislu 664b704e30 add delay 2024-05-05 14:17:41 -07:00
chrislu 4e3701df77 reset last error 2024-05-05 14:16:54 -07:00
chrislu 658d302aa4 init candidate servers when setting a starting snapshot 2024-05-05 14:16:26 -07:00
chrislu a5645d50a7 ensure head index is within range 2024-05-05 12:20:08 -07:00
chrislu 253ec73a17 log 2024-05-05 12:19:31 -07:00
chrislu f5f3b60a13 ignore 2024-05-05 12:19:21 -07:00
chrislu 30f8600a24 working 2024-05-03 21:27:06 -07:00
chrislu 7a9b115cc2 rename 2024-05-02 11:14:58 -07:00
chrislu 4a3e8869bb subscriber can unmarshal the record 2024-05-02 09:56:11 -07:00
chrislu 1c5043baf7 rename 2024-05-02 09:47:29 -07:00
chrislu f2f4630029 rename field types 2024-05-02 08:59:22 -07:00
chrislu b8af997e41 consistent with protobuf data types 2024-05-02 08:52:10 -07:00
chrislu 0f35b3a4ea add example to publish a record 2024-05-02 08:48:51 -07:00
chrislu 928a4e8dff rename 2024-05-02 08:35:06 -07:00
chrislu 5bc1b70a4c rename to WithField() 2024-05-02 08:32:15 -07:00
chrislu a568d128fb Merge branch 'master' into mq-subscribe 2024-05-02 08:13:53 -07:00
chrislu f80fb1c02e Merge branch 'master' into mq-subscribe 2024-04-29 21:57:31 -07:00
chrislu 5e8d788311 Merge branch 'master' into mq-subscribe 2024-04-29 06:44:03 -07:00
chrislu e6bfd061c7 AllowEmptyFolder checks during object deletion 2024-04-29 06:25:06 -07:00
chrislu d521466a37 split file 2024-04-29 06:23:42 -07:00
chrislu a1b59948cc rename files 2024-04-29 05:33:56 -07:00
chrislu b570e015ce Update write_parquet_test.go 2024-04-28 13:56:55 -07:00
chrislu 5dc186ef01 record value API 2024-04-28 13:42:45 -07:00
chrislu b166597c83 fix test 2024-04-28 13:03:01 -07:00
chrislu 189a7fc90e record type begin and end 2024-04-28 13:00:52 -07:00
chrislu 0da1b7b0f9 improve api 2024-04-28 12:42:58 -07:00
chrislu 1a2332c257 rename api 2024-04-28 12:40:00 -07:00
chrislu 5ce8f50546 Delete schema_builder_test.go 2024-04-28 12:39:27 -07:00
chrislu 8a0e5b6d54 struct to schema correctly 2024-04-28 12:23:54 -07:00
chrislu f37862bffe compile test 2024-04-28 12:23:33 -07:00
chrislu 7310d022ad recursive struct to schema 2024-04-28 11:14:13 -07:00
chrislu a2a872ca03 rename 2024-04-27 23:44:11 -07:00
chrislu 60103171b6 rename 2024-04-27 23:30:15 -07:00
chrislu 111a4e1126 add field index 2024-04-27 23:30:06 -07:00
chrislu 72b50980f4 a little bit more efficient 2024-04-25 23:59:30 -07:00
chrislu 8948fb51e3 Merge branch 'master' into mq-subscribe 2024-04-25 23:42:19 -07:00
chrislu 63036133ff minor 2024-04-25 22:02:03 -07:00
chrislu 2a9b0a9332 use parquet levels to construct row 2024-04-25 21:29:45 -07:00
chrislu 977e7988e6 toRow conversion with levels info 2024-04-25 09:14:37 -07:00
chrislu 9cb9d27b5b file rename 2024-04-25 08:56:31 -07:00
chrislu 313097aca0 printout test values 2024-04-25 08:54:57 -07:00
chrislu 827e293010 add visitor 2024-04-25 08:54:41 -07:00
chrislu 138a027a2e add field types but without value 2024-04-24 23:33:11 -07:00
chrislu 30b5aef62e record type is also optional 2024-04-24 23:32:35 -07:00
chrislu ce4597c623 delete the generated file 2024-04-24 23:29:55 -07:00
chrislu dbdb7c8abe Update .gitignore 2024-04-24 23:28:45 -07:00
chrislu f91484ca07 add some notes 2024-04-24 23:28:20 -07:00
chrislu f93c4cf48c adjust test 2024-04-24 23:24:53 -07:00
chrislu d88c1872ac works with single level of list 2024-04-24 23:04:47 -07:00
chrislu d7e5f6b2a5 fix ordering 2024-04-24 01:32:02 -07:00
chrislu 9ef238b610 has a bug 2024-04-22 00:42:18 -07:00
chrislu cc1ce3de87 all record fields are optional by default 2024-04-18 23:17:52 -07:00
chrislu 384ed7a381 add test 2024-04-18 22:41:20 -07:00
chrislu 57949f9959 support list type 2024-04-18 22:41:12 -07:00
chrislu 05d18130b6 add schema builder 2024-04-18 22:27:18 -07:00
chrislu 20666bdf81 Merge branch 'master' into mq-subscribe 2024-04-18 21:33:06 -07:00
chrislu 55976ae04a avoid repeated calls to heavy-weighted viper 2024-04-18 09:09:45 -07:00
chrislu 31f1f96038 improve perf a bit 2024-04-18 08:47:55 -07:00
chrislu d9490c5e1f rename 2024-04-18 08:47:45 -07:00
chrislu 0847a17484 convert to parquet schema and value 2024-04-17 23:49:21 -07:00
chrislu ce2b2fa9b2 Merge branch 'master' into mq-subscribe 2024-04-15 20:09:14 -07:00
chrislu 0edc5aad9a 3.65 2024-04-14 20:15:46 -07:00
chrislu 68ade92d4f publisher send schema 2024-04-12 23:36:15 -07:00
chrislu 8415476c2d fix test 2024-04-12 23:35:54 -07:00
chrislu 5324e4288a rename parameter 2024-04-12 22:33:00 -07:00
chrislu 6f80dbdfe5 Create schema.go 2024-04-12 22:31:28 -07:00
chrislu 53d1d2b78a save schema when configuring topic 2024-04-12 22:29:53 -07:00
chrislu 04fb4c34e3 add proto for value 2024-04-12 22:27:16 -07:00
chrislu 48fe50df81 minor 2024-04-12 13:31:54 -07:00
chrislu 0cbf364a3d all fields are optional 2024-04-12 13:29:35 -07:00
chrislu 7a72677f98 add test 2024-04-12 01:31:23 -07:00
chrislu d45a372615 add schema.proto 2024-04-12 01:30:29 -07:00
chrislu d5b2cee34a log possible racing condition
fix https://github.com/seaweedfs/seaweedfs/issues/5412
2024-04-11 23:44:54 -07:00
chrislu 2a4a9c6343 log possible racing condition
fix https://github.com/seaweedfs/seaweedfs/issues/5412
2024-04-11 23:44:18 -07:00
chrislu 7482a98833 Merge branch 'master' into mq-subscribe 2024-04-11 19:50:35 -07:00
chrislu 1410c062f8 go mod tidy 2024-04-11 19:50:25 -07:00
chrislu e53a972483 Merge branch 'master' into mq-subscribe 2024-04-11 19:48:00 -07:00
chrislu cc1c69f312 Merge branch 'master' into mq-subscribe 2024-04-08 11:03:14 -07:00
chrislu ccdd9cd8de refactor 2024-04-02 16:25:43 -07:00
chrislu f37c0d0d7a comment out println 2024-04-02 15:31:31 -07:00
chrislu d935f70e3c shutdown follower when leader stops 2024-04-01 22:32:30 -07:00
chrislu f07875e8e1 send flush message to follower before shutting down logBuffer 2024-04-01 16:01:26 -07:00
chrislu e568e742c9 renaming 2024-04-01 15:02:52 -07:00
chrislu 47975e75bf purge old code 2024-03-31 17:49:34 -07:00
chrislu 237e68059d shutdown follower if no clients, not only publishers
to avoid overhead when a publisher repeatedly send one message and close
2024-03-31 17:45:26 -07:00
chrislu 66a878af39 add control message to data message 2024-03-31 16:35:46 -07:00
chrislu 546ae87c39 send is_close message to broker 2024-03-31 01:28:40 -07:00
chrislu c9df613b6b add publisher name for debugging 2024-03-31 00:19:16 -07:00
chrislu ca4f89a6f6 simplify 2024-03-30 20:37:57 -07:00
chrislu 0d55bddc75 logs 2024-03-30 20:37:46 -07:00
chrislu 13b7c7b366 Merge branch 'master' into mq-subscribe 2024-03-27 23:57:00 -07:00