Chris Lu 8f2daad338 topology: mirror the writable volume list in a set (#11076) ...

Membership was a linear scan over a slice, and ensureCorrectWritables runs it
for every volume on every heartbeat, so the master's steady-state cost per
volume server is quadratic in that server's volume count.

BenchmarkSyncDataNodeRegistration, median of 3:

  1000 volumes     565.7us -> 535.0us    -5.4%
  100000 volumes    1.665s -> 55.3ms     -96.7%

Allocations are unchanged at both sizes, so the difference is the scan.

Claude-Session: https://claude.ai/code/session_01P3pE6J2UPFp6G3ksfMV4s1

2026-09-01 14:21:26 -07:00

..

balancer

topology/balancer: share replica selection between shell and workers (#10276)

2026-07-08 20:06:15 -07:00

allocate_volume.go

master: timeout AllocateVolume/DeleteVolume and defer growRequest cleanup (#9698)

2026-05-26 16:26:21 -07:00

cluster_commands.go

Prevent split-brain: Persistent ClusterID and Join Validation (#8022)

2026-01-18 14:02:34 -08:00

collection_statistics_test.go

master: let VolumeList ask for the volumes it wants (#10674)

2026-08-09 21:59:42 -07:00

collection_statistics.go

s3: take bucket sizes from the master's summary (#10664)

2026-08-09 00:00:19 -07:00

collection.go

master: keep a racing registration out of a dying collection (#10677)

2026-08-09 22:20:34 -07:00

configuration.go

chore(weed/topology): prune unused functions (#9249)

2026-04-27 15:54:52 -07:00

crowded_writable_test.go

topology: mark a volume crowded only if it can take writes (#10655)

2026-08-08 18:44:15 -07:00

data_center.go

master: let VolumeList ask for the volumes it wants (#10674)

2026-08-09 21:59:42 -07:00

data_node_ec_multi_disk_test.go

master: let VolumeList ask for the volumes it wants (#10674)

2026-08-09 21:59:42 -07:00

data_node_ec.go

fix(master): register EC shards per physical disk on full heartbeat sync (#9212) (#9219)

2026-04-24 14:01:09 -07:00

data_node_empty_disk_test.go

master: let VolumeList ask for the volumes it wants (#10674)

2026-08-09 21:59:42 -07:00

data_node.go

master: stop copying the cluster to name it (#10700)

2026-08-10 11:02:09 -07:00

disk_ec.go

fix(master): register EC shards per physical disk on full heartbeat sync (#9212) (#9219)

2026-04-24 14:01:09 -07:00

disk_info_test.go

master: let VolumeList ask for the volumes it wants (#10674)

2026-08-09 21:59:42 -07:00

disk_provisional_disk_id_test.go

topology: provisional volume update must not erase the reported disk id (#10687)

2026-08-10 00:41:33 -07:00

disk.go

master: cap the reported capacity at what the disks hold (#10960)

2026-08-26 00:12:56 -07:00

node.go

master: scope the startup capacity shed to a truly empty topology (#11058)

2026-08-31 21:29:27 -07:00

race_condition_stress_test.go

Fix concurrent map access in EC shards info (#8222)

2026-02-05 10:24:18 -08:00

rack.go

master: let VolumeList ask for the volumes it wants (#10674)

2026-08-09 21:59:42 -07:00

replication_metrics_test.go

feat: add Prometheus metrics for replication operations (#10006)

2026-06-19 11:05:43 -07:00

reported_volumes.go

topology: follow a volume that moved between a server's disks (#10628)

2026-08-07 19:44:39 -07:00

store_replicate_test.go

volume: forward fsync=true to replicas in ReplicatedWrite (#10805)

2026-08-18 17:17:50 -07:00

store_replicate.go

volume: forward fsync=true to replicas in ReplicatedWrite (#10805)

2026-08-18 17:17:50 -07:00

topology_ec_max_volume_id_test.go

fix(master): advance maxVolumeId when registering EC shards (#9827)

2026-06-04 22:25:30 -07:00

topology_ec.go

mount: report data sizes to df with -df.logical (#10459)

2026-07-27 14:28:29 -07:00

topology_event_handling.go

master: stop hintless small-file assigns from marking volumes full (#10944)

2026-08-25 10:16:48 -07:00

topology_heartbeat_bench_test.go

perf(weed/topology): preallocate the heartbeat volume conversion slice (#10607)

2026-08-07 00:21:16 -07:00

topology_info.go

master: stop copying the cluster to name it (#10700)

2026-08-10 11:02:09 -07:00

topology_stats_test.go

topology: clamp the deleted-vs-total subtractions in volume stats (#10633)

2026-08-07 19:49:44 -07:00

topology_test.go

topology: refresh oversized mark on every heartbeat (#10829)

2026-08-20 09:56:53 -07:00

topology_vacuum.go

topology: keep per-node volume state with the location it describes (#10654)

2026-08-08 20:56:08 -07:00

topology.go

master: cap the reported capacity at what the disks hold (#10960)

2026-08-26 00:12:56 -07:00

volume_digest_test.go

volume: cut idle memory at high volume counts (#10861)

2026-08-21 13:04:56 -07:00

volume_disk_move_test.go

topology: follow a volume that moved between a server's disks (#10628)

2026-08-07 19:44:39 -07:00

volume_filter_test.go

get volume topology info without volume details (#11036)

2026-08-31 09:45:22 -07:00

volume_filter.go

get volume topology info without volume details (#11036)

2026-08-31 09:45:22 -07:00

volume_growth_reservation_test.go

chore(weed/topology): prune unused functions (#9249)

2026-04-27 15:54:52 -07:00

volume_growth_test.go

Treat co-located volume servers as one fault domain when balancing and allocating (#9854)

2026-06-07 14:14:45 -07:00

volume_growth.go

heartbeat: keep the master current through collection churn (#10657)

2026-08-08 20:23:10 -07:00

volume_index_digest.go

master: keep a racing registration out of a dying collection (#10677)

2026-08-09 22:20:34 -07:00

volume_layout_capacity_recovery_test.go

master: stop hintless small-file assigns from marking volumes full (#10944)

2026-08-25 10:16:48 -07:00

volume_layout_drain_test.go

master: stop hintless small-file assigns from marking volumes full (#10944)

2026-08-25 10:16:48 -07:00

volume_layout_grow_test.go

master: keep periodic volume growth to the data centers a layout lives in (#11060)

2026-09-01 00:40:50 -07:00

volume_layout_oversized_heartbeat_test.go

master: stop hintless small-file assigns from marking volumes full (#10944)

2026-08-25 10:16:48 -07:00

volume_layout_pick_bench_test.go

feat(master): size-aware volume assignment with weighted selection (#9031)

2026-04-11 09:19:05 -07:00

volume_layout_pick_test.go

topology: mirror the writable volume list in a set (#11076)

2026-09-01 14:21:26 -07:00

volume_layout_size_tracking_test.go

topology: track volume size only where writes can land (#10653)

2026-08-08 20:55:55 -07:00

volume_layout.go

topology: mirror the writable volume list in a set (#11076)

2026-09-01 14:21:26 -07:00

volume_location_flags_test.go

topology: keep per-node volume state with the location it describes (#10654)

2026-08-08 20:56:08 -07:00

volume_location_list.go

storage: count a volume's needles in uint32 (#10718)

2026-08-11 16:36:36 -07:00

volume_stream_bounds_test.go

master: stream volume listings (#10676)

2026-08-10 09:41:00 -07:00

volume_stream_test.go

clients: stream the volume listings that ask for everything (#10679)

2026-08-10 09:51:08 -07:00

volume_stream.go

filter volume by local or remote storage name (#10946)

2026-08-25 13:05:33 -07:00