Iceberg Table Maintenance
Chris Lu edited this page 2026-08-21 10:51:39 -07:00
Clone

Wiki Page Revisions

9 Commits

Author SHA1 Message Date
Chris Lu b4a474bb7a Document the Lance catalog, its worker, and worker metrics
Lance appeared nowhere in the wiki, and two pages said a table bucket is
Iceberg. New: SeaweedFS Lance Catalog, LanceDB Integration, Lance
Maintenance Worker. Updated: table bucket pages for the format
declaration, Worker and System Metrics for what a plugin worker publishes,
Plugin Worker Scheduling for the lance job types and lanes, and Iceberg
Table Maintenance for the foreign-format skip that keeps orphan cleanup
away from Lance fragments.
2026-08-21 10:51:39 -07:00
Chris Lu 400fb54280 document credential vending, view rename, and ref-aware snapshot expiry
The catalog page gained a credential vending section: the delegation
header, the role flag that turns it on, and what the vended session is
scoped to. The API matrix marks ReportMetrics supported, adds RenameView
and the LoadTable snapshots parameter, and describes what concurrent
commits now do.

Maintenance: a snapshot a branch or tag points at is never expired, and a
branch's own retention governs the ancestors behind its head.

Also corrects the naming charset, which has allowed hyphens since #10093.
2026-08-16 13:00:07 -07:00
Chris Lu 5febe6078f document the S3 Tables maintenance configuration APIs
The maintenance page presented the worker config as the only source of
truth. Table properties now win over it, so the page said the wrong thing
about every threshold it documented.

Adds where settings come from, the five new APIs and their settings, the
new table_properties_override and rewrite_strategy=auto knobs, the IAM
action names, and CLI walkthroughs.
2026-08-16 10:39:38 -07:00
Chris Lu f54074f133 updated table buckets based on new tests 2026-05-03 00:19:30 -07:00
Chris Lu 97f8ac72be Remove delete manifest limitation — it's an implementation detail, not user-facing 2026-03-15 19:22:08 -07:00
Chris Lu 2201688e9d Update Iceberg maintenance wiki for Phase 3
- Document multi-partition-spec compaction (grouping by spec + partition)
- Document delete-aware compaction (position + equality deletes)
- Add apply_deletes config parameter
- Fix target_file_size_bytes → target_file_size_mb (matches actual config)
- Remove obsolete limitations (delete manifests, multi-spec)
- Add structured metrics reference table
- Update skip conditions and rewrite manifests threshold messaging
2026-03-15 19:20:52 -07:00
Chris Lu 9e5fe81a79 adjust limitation 2026-03-15 12:14:06 -07:00
Chris Lu 42d5d900a9 Update Iceberg-Table-Maintenance.md 2026-03-15 10:03:15 -07:00
Chris Lu 2aea32e201 add iceberg table maintenance 2026-03-07 12:11:44 -08:00