Chris LuandClaude Opus 5.5 512f898600 s3 lifecycle: report work-based job progress during a pass (#12644) ...

* s3 lifecycle: report work-based job progress during a pass

The daily pass sent progress only while starting, so a healthy scan that
ran for many hours could reach the admin's 24-hour no-progress guard.
Worker heartbeats prove the worker is alive, not that this job moves.

While dailyrun.Run is in progress the handler now sends a progress update
every 5 minutes, and only when the pass's counters (entries visited,
replay events, RPC outcomes including errors) moved since the last
delivered update. An idle tick sends nothing, so a stalled pass still
expires. A failed send is retried on the next tick. The reporter is
stopped and joined before the completion is sent, so no progress can
follow the terminal result.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* admin: test that progress, not heartbeats, keeps an old job active

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* s3 lifecycle: label progress phase and bucket as the last started

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-14 10:55:08 -08:00

..

cluster_rate_limit_test.go

feat(s3/lifecycle): cluster rate-limit allocation (Phase 3) (#9456)

2026-05-11 19:17:06 -07:00

cluster_rate_limit.go

fix(admin): carry filer addresses as ServerAddress in plugin cluster context (#9600)

2026-05-21 02:10:27 -07:00

config_store_test.go

admin: explain detection cooldowns and skipped scans (#12185)

2026-10-28 22:55:36 -07:00

config_store.go

admin: explain detection cooldowns and skipped scans (#12185)

2026-10-28 22:55:36 -07:00

DESIGN.md

admin: default to port 12535, keep 23646 as a best-effort compat listener (#11816)

2026-10-18 21:21:05 -07:00

host_affinity.go

EC worker: pin jobs to replica-host workers, late-bind local source (#11718)

2026-10-13 05:31:34 +08:00

job_execution_plan.go

fix(admin.plugin): include disk_id in EC execution plan (#9547)

2026-05-18 19:43:18 -07:00

lock_manager.go

add admin script worker (#8491)

2026-03-03 15:10:40 -08:00

observations_test.go

Lance catalog, and a Rust plugin worker to maintain it (#10841)

2026-08-19 22:59:56 -07:00

observations.go

Lance catalog, and a Rust plugin worker to maintain it (#10841)

2026-08-19 22:59:56 -07:00

orphaned_execution_test.go

admin/plugin: fail a dispatch its restarted worker no longer lists (#12402)

2026-11-04 11:45:41 -08:00

orphaned_execution.go

admin/plugin: fail a dispatch its restarted worker no longer lists (#12402)

2026-11-04 11:45:41 -08:00

plugin_cancel_test.go

chore: remove ~50k lines of unreachable dead code (#8913)

2026-04-03 16:04:27 -07:00

plugin_config_bootstrap_test.go

refactor(plugin): rename detection_interval_seconds → detection_interval_minutes (#9366)

2026-05-08 10:33:02 -07:00

plugin_detection_disconnect_test.go

admin: let a buffered detection completion win over the stream closing (#12379)

2026-11-03 12:53:28 -08:00

plugin_detection_test.go

admin: explain detection cooldowns and skipped scans (#12185)

2026-10-28 22:55:36 -07:00

plugin_monitor_test.go

s3 lifecycle: report work-based job progress during a pass (#12644)

2026-11-14 10:55:08 -08:00

plugin_monitor.go

s3 lifecycle: per-pass run results and last full-pass status (#12643)

2026-11-14 10:50:37 -08:00

plugin_scheduler_test.go

admin: credit an unitemized slot to a pending job only after a later heartbeat (#12385)

2026-11-03 20:45:39 -08:00

plugin_scheduler.go

admin: credit an unitemized slot to a pending job only after a later heartbeat (#12385)

2026-11-03 20:45:39 -08:00

plugin_schema_prefetch.go

admin: explain detection cooldowns and skipped scans (#12185)

2026-10-28 22:55:36 -07:00

plugin.go

admin/plugin: fail a dispatch its restarted worker no longer lists (#12402)

2026-11-04 11:45:41 -08:00

preview_test.go

admin: fail an in-flight detection when its worker disconnects (#12376)

2026-11-03 12:28:39 -08:00

preview.go

Lance catalog, and a Rust plugin worker to maintain it (#10841)

2026-08-19 22:59:56 -07:00

registry_snapshot_test.go

fix: clone protobuf snapshots without copying internal locks (#11968)

2026-10-22 18:38:33 -07:00

registry_test.go

EC worker: pin jobs to replica-host workers, late-bind local source (#11718)

2026-10-13 05:31:34 +08:00

registry.go

admin: credit an unitemized slot to a pending job only after a later heartbeat (#12385)

2026-11-03 20:45:39 -08:00

scheduler_config.go

simplify plugin scheduler: remove configurable IdleSleepSeconds, use constant 61s

2026-03-09 22:41:03 -07:00

scheduler_lane_test.go

Lance catalog, and a Rust plugin worker to maintain it (#10841)

2026-08-19 22:59:56 -07:00

scheduler_lane.go

weed-worker: build the vector index of S3 Vectors tables past a row threshold (ANN phase 2) (#12413)

2026-11-04 22:16:31 -08:00

scheduler_status_test.go

admin: explain detection cooldowns and skipped scans (#12185)

2026-10-28 22:55:36 -07:00

scheduler_status.go

admin: explain detection cooldowns and skipped scans (#12185)

2026-10-28 22:55:36 -07:00

types.go

refactor(plugin): rename detection_interval_seconds → detection_interval_minutes (#9366)

2026-05-08 10:33:02 -07:00

worker_job_queues_test.go

admin: count executor slots per job type and stop lanes waiting on capacity they cannot free (#12384)

2026-11-03 15:10:26 -08:00

worker_job_queues.go

admin: count executor slots per job type and stop lanes waiting on capacity they cannot free (#12384)

2026-11-03 15:10:26 -08:00