Chris LuandDevin 1451096c17 volume.fsck: delete missing filer entries through a worker pool (#11924) ...

* volume.fsck: delete missing filer entries through a worker pool

-reallyDeleteFilerEntries issued one synchronous HTTP DELETE per orphan
path inside the BFS consumer, so a million-entry purge ran one request
at a time. Queue the confirmed paths onto a bounded pool (default 16,
-tunable via -purgeConcurrency) so deletes run in parallel while the
traversal continues.

Generated with [Devin](https://devin.ai)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* volume.fsck: serialize command output across purge workers

* volume.fsck: serialize purges that share a hard link id

* volume.fsck: cover the purge worker pool

* volume.fsck: take the purge shard remainder in unsigned arithmetic

Generated with [Devin](https://devin.ai)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>

2026-10-21 20:37:57 -07:00

..

admin

Add OLake to README and Admin UI; fix catalog_olake path-style docs (#11858)

2026-10-20 04:57:55 -07:00

cluster

filer: announce to master only once gRPC serves, and leave before it stops (#11700)

2026-10-11 21:10:46 +08:00

command

s3: skip the local filer socket on Windows (#11921)

2026-10-21 20:35:19 -07:00

credential

iam: targeted writes for single-user IAM actions (#11877)

2026-10-20 17:41:37 -07:00

ec

ec: compare live idx NeedleId sets before encode (#11812)

2026-10-19 00:56:17 -07:00

filer

fix: volume.fsck purges live chunks of files renamed during its filer walk (SQL stores) (#11883)

2026-10-21 20:31:42 -07:00

filer_client

fix: resolve gRPC DNS resolution issues in Kubernetes #8384 (#8387)

2026-02-19 15:46:02 -08:00

glog

go fmt

2026-04-10 17:31:14 -07:00

iam

s3, iceberg: record the access key a request was signed with (#11901)

2026-10-21 20:33:08 -07:00

iamapi

iam: optionally require an iam: grant for self-service access-key actions (#11937)

2026-10-21 20:06:30 -07:00

images

image: add an optional public image processing gateway (#11593)

2026-10-05 19:49:02 +08:00

kms

kms/azure: fix encrypt/decrypt round trip for Azure Key Vault (#11692)

2026-10-10 23:40:19 +08:00

mount

mount: release flock locks before the close-time flush (#11726)

2026-10-15 22:38:03 -07:00

mq

filer: announce to master only once gRPC serves, and leave before it stops (#11700)

2026-10-11 21:10:46 +08:00

notification

kafka: honor notification.kafka.event_types (#11601)

2026-10-05 21:15:06 +08:00

operation

volume: report the needle read error with a failed read (#11934)

2026-10-21 20:24:48 -07:00

pb

fix: volume.fsck purges live chunks of files renamed during its filer walk (SQL stores) (#11883)

2026-10-21 20:31:42 -07:00

placement

placement: let callers reject candidates placement cannot judge (#10581)

2026-08-05 00:18:22 -07:00

plugin/worker

EC worker: pin jobs to replica-host workers, late-bind local source (#11718)

2026-10-13 05:31:34 +08:00

query

filer: fail the request, not the process, when chunks cannot be resolved (#11685)

2026-10-10 23:39:29 +08:00

remote_storage

remote_storage/s3: use the AWS default credential chain when a source is configured (#11881)

2026-10-21 20:30:28 -07:00

replication

filer.sync: unstick sync on chunks the source no longer has (#11845)

2026-10-19 18:11:51 -07:00

s3api

s3, iceberg: record the access key a request was signed with (#11901)

2026-10-21 20:33:08 -07:00

security

security: share the admin gRPC peer authentication check

2026-10-12 02:55:50 -07:00

sequence

[nfs] Add NFS (#9067)

2026-04-14 20:48:24 -07:00

server

fix: volume.fsck purges live chunks of files renamed during its filer walk (SQL stores) (#11883)

2026-10-21 20:31:42 -07:00

sftpd

sftp: reject empty passwords in PasswordAuthenticator (#11938)

2026-10-21 20:03:14 -07:00

shell

volume.fsck: delete missing filer entries through a worker pool (#11924)

2026-10-21 20:37:57 -07:00

static

adjust logo

2026-04-23 10:05:51 -07:00

stats

Detect and quarantine duplicate volume ids (#11763) (#11828)

2026-10-20 07:37:33 -07:00

storage

volume.configure: keep the superblock in sync with the .vif (#11930)

2026-10-21 20:18:56 -07:00

telemetry

telemetry: keep only clusters that store at least 10 GiB (#11138)

2026-09-03 12:36:00 -07:00

topology

volume: never compact a volume tiered to remote storage (#11895)

2026-10-21 20:16:02 -07:00

util

volume: report the needle read error with a failed read (#11934)

2026-10-21 20:24:48 -07:00

wdclient

filer: announce to master only once gRPC serves, and leave before it stops (#11700)

2026-10-11 21:10:46 +08:00

worker

volume: never compact a volume tiered to remote storage (#11895)

2026-10-21 20:16:02 -07:00

Makefile

Move SQL engine and PostgreSQL server to their own binaries (#8417)

2026-02-23 16:27:08 -08:00

weed.go

shell: exit non-zero when a piped command fails (#11117)

2026-09-02 22:12:51 -07:00