add Blob Store Architecture and Helm Chart Recipes
Blob Store Architecture takes the master and volume server walkthrough
that used to live in the README: assign, write, read, replication and
data center placement, then how the master tracks volumes instead of
files, and the disk notes.
Helm Chart Recipes gives copy-paste values files for a three-node S3
cluster, a development cluster, a lakehouse with the Iceberg catalog
exposed, filer metadata on PostgreSQL, and node-local disks. Every
recipe renders against the current chart.
Claude-Session: https://claude.ai/code/session_014apMEkkquAtAYp89paTkAT
DuckDB reads Lance tables out of a table bucket over S3 with no catalog
involved, which is the property that keeps the data readable by anything
that does not speak the namespace protocol.
Records the one place the layout costs us: DuckDB's replacement scan
recognises a dataset by a .lance path suffix, which tables created through
this catalog deliberately do not have, so __lance_scan is the way in. Also
notes that the documented ATTACH ... (TYPE lance) form fails in 1.5.5.
Spark reaches the Lance catalog through the connector's DSV2 catalog, the
same way it reaches the Iceberg one. Covers the storage.* prefix, which is
object_store's key names rather than Spark's s3a ones, and the two things
the integration suite settled: CREATE TABLE works because the connector
declares and writes rather than pushing Arrow at the server, and SHOW
TABLES returns namespace identifiers rather than bare table names.
Document the Lance catalog, its worker, and worker metrics
Lance appeared nowhere in the wiki, and two pages said a table bucket is
Iceberg. New: SeaweedFS Lance Catalog, LanceDB Integration, Lance
Maintenance Worker. Updated: table bucket pages for the format
declaration, Worker and System Metrics for what a plugin worker publishes,
Plugin Worker Scheduling for the lance job types and lanes, and Iceberg
Table Maintenance for the foreign-format skip that keeps orphan cleanup
away from Lance fragments.
S3 lifecycle docs: recipes page, accurate metrics, drop stale knobs
- add S3-Lifecycle-Recipes with copy-paste configs and verification
- link the Architecture/Monitoring/Operator/Troubleshooting/Recipes
sub-pages from the sidebar; they were orphaned from nav
- fix Prometheus metric names to the real SeaweedFS_ namespace; the
bare s3_lifecycle_ names matched nothing in a scrape
- main page: raw XML wire format, 1 MiB / error-code validation table,
Transition rejected (not ignored), GET legacy directory-TTL fallback
- document events_total and schedule_depth; run-shard flag table
- drop max_runtime_minutes (removed); per-pass cap is now the
scheduler Execution Timeout, default effectively unbounded
- Days < 1 is client-side only; server stores Days=0 as a no-op
New page covers projecting a SA token, exposing cluster OIDC discovery, and
assuming a role via AssumeRoleWithWebIdentity. Also fix OIDC-Integration trust
policy examples to use oidc:iss instead of the unpopulated seaweed:Issuer key.
NFS-Server: add wiki page for experimental NFSv3 server
Documents the weed nfs command, its configuration surface (safer
defaults, allowedClients, readOnly, volumeServerAccess), architecture
notes on deterministic filehandles + inode secondary index + metadata
subscription, client mount syntax for Linux and macOS, and the current
limitations (no shared locks, 64 MiB buffered write cap, no portmapper
registration). Also links the new page into the sidebar next to SFTP
Server and WebDAV.
- weed-shell.md: replace s3.configure and s3.bucket.access in command
listing with new commands (s3.user.*, s3.accesskey.*, s3.anonymous.*,
s3.serviceaccount.*, s3.policy.attach|detach, s3.iam.*, s3.config.show,
s3.user.provision). Add "S3 IAM Management" section with workflow examples.
- S3-Credentials.md: update shell examples to use new commands instead
of s3.configure.
- S3-Configuration.md: add shell command examples to Embedded IAM section.
- _Sidebar.md: add weed shell link under S3 Authentication & IAM.
- Comprehensive SFTP server setup and configuration guide
- Covers user management, SSH authentication, and JWT integration
- Includes production setup, security considerations, and troubleshooting
- Add SFTP-Server link to sidebar navigation
Chris Lu