Chris Lu 9e98ec4b2e Share decoded metadata-log entries across subscriber replays (#9903) ...

perf(filer): share decoded log entries across metadata replays

Concurrent SubscribeMetadata replays of the same persisted log history each
opened a chunk reader per source filer and re-decoded the same files, so a
reconnect storm multiplied into many GB of buffers. Cache the decoded entries
of completed log files in a bounded LRU, coalescing concurrent loads with
single-flight and bounding concurrent decodes. Each hit is validated against
the file's current chunk set, so a file that received a late append is
reloaded rather than served stale; reads that stop on an unreachable chunk are
delivered but not cached so a transient outage re-probes on the next replay.

2026-06-09 13:34:11 -07:00

..

abstract_sql

refactor: avoid unused sql insert result (#9734)

2026-05-29 00:45:45 -07:00

arangodb

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

cassandra

feat: add TLS configuration options for Cassandra2 store (#7998)

2026-01-14 17:59:59 -08:00

cassandra2

feat: add TLS configuration options for Cassandra2 store (#7998)

2026-01-14 17:59:59 -08:00

elastic/v7

go fix

2026-02-20 18:42:00 -08:00

empty_folder_cleanup

go fmt

2026-04-10 17:31:14 -07:00

etcd

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

foundationdb

go fix

2026-02-20 18:42:00 -08:00

hbase

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

leveldb

feat(filer): object size distribution metric and dashboard panels (#9902)

2026-06-09 10:41:11 -07:00

leveldb2

filer: reuse the caller's fetched entry in CreateEntry (#9645)

2026-05-23 21:40:41 -07:00

leveldb3

filer: reuse the caller's fetched entry in CreateEntry (#9645)

2026-05-23 21:40:41 -07:00

mongodb

fix(mongodb): merge URI auth fields with username/password override (#9889)

2026-06-09 00:18:33 -07:00

mysql

filer: keep S3 list order byte-lexicographic regardless of SQL name column collation (#9824)

2026-06-04 14:33:41 -07:00

mysql2

filer: keep S3 list order byte-lexicographic regardless of SQL name column collation (#9824)

2026-06-04 14:33:41 -07:00

posixlock

filer/posixlock: remove the unused lock-set serde (#9676)

2026-05-25 13:15:19 -07:00

postgres

filer: keep S3 list order byte-lexicographic regardless of SQL name column collation (#9824)

2026-06-04 14:33:41 -07:00

postgres2

filer: keep S3 list order byte-lexicographic regardless of SQL name column collation (#9824)

2026-06-04 14:33:41 -07:00

redis

fix(weed/filer/redis): dropped error (#8895)

2026-04-02 15:39:04 -07:00

redis2

redis2: apply keyPrefix in KV methods (#9693)

2026-05-26 12:49:31 -07:00

redis3

fix(redis3): prevent filer crash from inconsistent skiplist ends (#9602)

2026-05-21 02:12:00 -07:00

rocksdb

filer: reuse the caller's fetched entry in CreateEntry (#9645)

2026-05-23 21:40:41 -07:00

sqlite

go fix

2026-02-20 18:42:00 -08:00

store_test

fix(weed/filer/store_test): fix dropped errors (#8782)

2026-03-26 12:07:48 -07:00

tarantool

go fix

2026-02-20 18:42:00 -08:00

tikv

go fix

2026-02-20 18:42:00 -08:00

ydb

go fix

2026-02-20 18:42:00 -08:00

configuration.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

copy_params.go

Use filer-side copy for mounted whole-file copy_file_range (#8747)

2026-03-23 18:35:15 -07:00

entry_codec_atime_test.go

feat(filer): add atime to FuseAttributes + TouchAccessTime RPC (#9556)

2026-05-19 10:22:17 -07:00

entry_codec.go

feat(filer): add atime to FuseAttributes + TouchAccessTime RPC (#9556)

2026-05-19 10:22:17 -07:00

entry.go

feat(filer): add atime to FuseAttributes + TouchAccessTime RPC (#9556)

2026-05-19 10:22:17 -07:00

filechunk_group_test.go

Context cancellation during reading range reading large files (#7093)

2025-08-06 10:09:26 -07:00

filechunk_group.go

mount: improve read throughput with parallel chunk fetching (#7569)

2025-11-29 10:06:11 -08:00

filechunk_manifest_test.go

fix(mount): remove fid pool to stop master over-allocating volumes (#9111)

2026-04-16 15:51:13 -07:00

filechunk_manifest.go

fix(mount): remove fid pool to stop master over-allocating volumes (#9111)

2026-04-16 15:51:13 -07:00

filechunk_section_test.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

filechunk_section.go

mount: improve read throughput with parallel chunk fetching (#7569)

2025-11-29 10:06:11 -08:00

filechunks2_test.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

filechunks_read_test.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

filechunks_read.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

filechunks_test.go

S3 API: Advanced IAM System (#7160)

2025-08-30 11:15:48 -07:00

filechunks.go

fix: multipart upload ETag calculation (#8238)

2026-02-06 21:54:43 -08:00

filer_buckets.go

Prevent bucket renaming in filer, fuse mount, and S3 (#8048)

2026-01-16 19:48:09 -08:00

filer_conf_test.go

s3: auto-enforce bucket quota read-only both ways (#9774)

2026-06-01 13:11:18 -07:00

filer_conf.go

s3: auto-enforce bucket quota read-only both ways (#9774)

2026-06-01 13:11:18 -07:00

filer_delete_entry.go

filer: propagate lazy metadata deletes to remote mounts (#8522)

2026-03-12 13:16:28 -07:00

filer_deletion_test.go

Filer: Add retry mechanism for failed file deletions (#7402)

2025-10-29 18:31:23 -07:00

filer_deletion.go

Filer: Add retry mechanism for failed file deletions (#7402)

2025-10-29 18:31:23 -07:00

filer_hardlink.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

filer_inode_test.go

refactor(filer): remove the inode->path index and the NFS gateway (#9724)

2026-05-28 15:00:18 -07:00

filer_inode.go

refactor(filer): remove the inode->path index and the NFS gateway (#9724)

2026-05-28 15:00:18 -07:00

filer_lazy_remote_listing.go

filer: reuse the caller's fetched entry in CreateEntry (#9645)

2026-05-23 21:40:41 -07:00

filer_lazy_remote_test.go

refactor(filer): remove the inode->path index and the NFS gateway (#9724)

2026-05-28 15:00:18 -07:00

filer_lazy_remote.go

filer: reuse the caller's fetched entry in CreateEntry (#9645)

2026-05-23 21:40:41 -07:00

filer_notify_append.go

filer: reuse the caller's fetched entry in CreateEntry (#9645)

2026-05-23 21:40:41 -07:00

filer_notify_read.go

Share decoded metadata-log entries across subscriber replays (#9903)

2026-06-09 13:34:11 -07:00

filer_notify_test.go

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

filer_notify.go

Fix filer metadata-replay OOM under mount reconnect storms (#9901)

2026-06-09 11:43:12 -07:00

filer_on_meta_event_test.go

Adjust rename events metadata format (#8854)

2026-03-30 18:25:11 -07:00

filer_on_meta_event.go

Adjust rename events metadata format (#8854)

2026-03-30 18:25:11 -07:00

filer_rename.go

Prevent bucket renaming in filer, fuse mount, and S3 (#8048)

2026-01-16 19:48:09 -08:00

filer_search.go

filer: async empty folder cleanup via metadata events (#7614)

2025-12-03 21:12:19 -08:00

filer.go

Share decoded metadata-log entries across subscriber replays (#9903)

2026-06-09 13:34:11 -07:00

filerstore_hardlink.go

fix(filer): update hard link ctime when nlink changes on unlink (#9018)

2026-04-10 11:23:52 -07:00

filerstore_translate_path.go

Add error list each entry func (#7485)

2025-11-25 19:35:19 -08:00

filerstore_wrapper_test.go

fix(filer): remove cancellation guard from RollbackTransaction and clean up #8909 (#8916)

2026-04-03 17:55:27 -07:00

filerstore_wrapper.go

refactor(filer): remove the inode->path index and the NFS gateway (#9724)

2026-05-28 15:00:18 -07:00

filerstore.go

Add error list each entry func (#7485)

2025-11-25 19:35:19 -08:00

gateway_upload.go

[nfs] Add NFS (#9067)

2026-04-14 20:48:24 -07:00

interval_list_test.go

chore: execute goimports to format the code (#7983)

2026-01-07 13:06:08 -08:00

interval_list.go

Mount concurrent read (#4400)

2023-04-13 22:32:45 -07:00

meta_aggregator.go

fix(filer.sync): guard batched events against nil EventNotification (#9877)

2026-06-08 13:56:16 -07:00

meta_replay.go

chore: remove ~50k lines of unreachable dead code (#8913)

2026-04-03 16:04:27 -07:00

metadata_event_context.go

Adjust rename events metadata format (#8854)

2026-03-30 18:25:11 -07:00

metadata_event_sink_test.go

mount: make metadata cache rebuilds snapshot-consistent (#8531)

2026-03-07 09:19:40 -08:00

metadata_event_sink.go

mount: make metadata cache rebuilds snapshot-consistent (#8531)

2026-03-07 09:19:40 -08:00

mount_peer_registry_test.go

peer chunk sharing 2/8: filer mount registry (#9131)

2026-04-18 20:03:23 -07:00

mount_peer_registry.go

peer chunk sharing 2/8: filer mount registry (#9131)

2026-04-18 20:03:23 -07:00

persisted_log_cache_test.go

Share decoded metadata-log entries across subscriber replays (#9903)

2026-06-09 13:34:11 -07:00

persisted_log_cache.go

Share decoded metadata-log entries across subscriber replays (#9903)

2026-06-09 13:34:11 -07:00

read_remote.go

improve: large file sync throughput for remote.cache and filer.sync (#8676)

2026-03-17 16:49:56 -07:00

read_write.go

feat(s3/lifecycle): filer-backed cursor Persister + drop BlockerStore (#9358)

2026-05-07 17:45:04 -07:00

reader_at_test.go

Context cancellation during reading range reading large files (#7093)

2025-08-06 10:09:26 -07:00

reader_at.go

mount: improve read throughput with parallel chunk fetching (#7627)

2025-12-04 23:40:56 -08:00

reader_cache_test.go

feat(mount): singleflight dedup for concurrent chunk reads (#9100)

2026-04-16 10:18:05 -07:00

reader_cache.go

feat(mount): singleflight dedup for concurrent chunk reads (#9100)

2026-04-16 10:18:05 -07:00

reader_pattern.go

Fix a few data races when reading files in mount (#3527)

2022-08-26 16:41:37 -07:00

remote_mapping.go

feat(s3/lifecycle): filer-backed cursor Persister + drop BlockerStore (#9358)

2026-05-07 17:45:04 -07:00

remote_storage_test.go

Add data file compaction to iceberg maintenance (Phase 2) (#8503)

2026-03-15 11:27:42 -07:00

remote_storage.go

s3api: fix static IAM policy enforcement after reload (#8532)

2026-03-06 12:35:08 -08:00

s3iam_conf_test.go

s3: fix configuring IAM for the same user

2022-08-30 09:37:52 -07:00

s3iam_conf.go

convert error fromating to %w everywhere (#6995)

2025-07-16 23:39:27 -07:00

stream_benchmark_test.go

go fmt

2026-04-10 17:31:14 -07:00

stream_prefetch_test.go

feat(s3): add concurrent chunk prefetch for large file downloads (#8917)

2026-04-03 19:57:30 -07:00

stream_prefetch.go

feat(s3): add concurrent chunk prefetch for large file downloads (#8917)

2026-04-03 19:57:30 -07:00

stream.go

Fix filer metadata-replay OOM under mount reconnect storms (#9901)

2026-06-09 11:43:12 -07:00

topics.go

merge current message queue code changes (#6201)

2024-11-04 12:08:25 -08:00