Eliah RusinandClaude Fable 5.1 3f9b05946b rust volume: bound the redb index cache per volume by --index tier (#11180) ...

The Rust volume server opens one redb database per volume and built
each with redb's defaults, which give every database a 1 GiB page
cache (0.9 GiB read cache + 0.1 GiB write buffer). With hundreds of
volumes behind one disk the process-wide ceiling was volumes x 1 GiB:
memory grew in proportion to the pages traffic touched, never shrank
when traffic stopped, and hosts running many instances were OOM-killed
under bulk ingest. redb, redbMedium and redbLarge were also treated
identically, so the "memory~performance" tiers did nothing.

Size the cache per tier instead: 4, 8 and 16 MiB per volume, mirroring
the Go server's 3/6/12 MiB LevelDB block cache + write buffer. Thread
the budget through RedbNeedleMap::new/load_from_idx so every open path
(create, reuse, full rebuild) uses Database::builder().set_cache_size.

Fixes #11179


Claude-Session: https://claude.ai/code/session_019x36FiSeyePh77YXao15kK

Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-05 10:56:42 -07:00

..

erasure_coding

volume: open volume files with O_NOATIME (#11055)

2026-08-31 21:41:50 -07:00

idx

volume: expire TTL volumes whose only traffic is deletes (#11167)

2026-09-04 23:48:40 -07:00

needle

fix(volume): reject overflowing needle ID deltas (#10342)

2026-07-15 23:24:04 -07:00

needle_map

volume: open volume files with O_NOATIME (#11055)

2026-08-31 21:41:50 -07:00

disk_location.rs

ec: refuse to mount a 0-byte shard file when the index has entries (#11030)

2026-08-29 14:19:16 -07:00

mod.rs

volume: rebuild a missing .idx from the .dat (#11115)

2026-09-03 08:43:10 -07:00

needle_map.rs

rust volume: bound the redb index cache per volume by --index tier (#11180)

2026-09-05 10:56:42 -07:00

store_ec_mirror.rs

fix(ec): don't mix EC shards from different encode runs (#9880)

2026-06-10 22:31:18 -07:00

store_ec_reconcile.rs

Add codespell support with configuration and typo fixes (#10393)

2026-07-22 14:38:06 -07:00

store.rs

ec: pin auto-selected shard placement to the disk that already owns the shard (#11029)

2026-08-29 12:12:41 -07:00

super_block.rs

Rust volume server implementation with CI (#8539)

2026-03-26 17:24:35 -07:00

types.rs

Rust volume server implementation with CI (#8539)

2026-03-26 17:24:35 -07:00

volume_idx_rebuild.rs

volume: rebuild a missing .idx from the .dat (#11115)

2026-09-03 08:43:10 -07:00

volume_idx_repair.rs

rust: honor fsync on the volume server write path (#10816)

2026-08-18 20:22:42 -07:00

volume_open.rs

volume: open volume files with O_NOATIME (#11055)

2026-08-31 21:41:50 -07:00

volume_report_hash.rs

storage: stop keeping the remote storage key on the master (#10672)

2026-08-09 12:43:31 -07:00

volume_report.rs

volume: cut idle memory at high volume counts (#10861)

2026-08-21 13:04:56 -07:00

volume.rs

rust volume: bound the redb index cache per volume by --index tier (#11180)

2026-09-05 10:56:42 -07:00