seaweedfs

Github-Mirror/seaweedfs

Fork 0

mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-09-19 13:00:45 +02:00

Files

T

History

Chris Lu a6d72bc272 s3api: delete orphaned chunks only when the entry is confirmed absent (#11389 )

* s3api: test for chunks deleted under an entry the filer committed

Issue #11387: the filer can report a create failure after inserting the
entry (e.g. a parent-directory creation failing post-insert). The error
arrives in the response rather than as a transport status, so it maps
to a definitive error and putToFiler deletes the chunks of the live
entry.

* s3api: confirmCreateLanded also reports a confirmed-absent entry

The verification a failed create runs can answer both directions: the
entry matching the uploaded chunks proves the write landed, and an
authoritative not-found proves the uploaded chunks are orphaned. Return
both outcomes so the cleanup path can gate on the fact rather than the
error class. An empty upload can never prove a landing, so a zero-chunk
entry match no longer upgrades the outcome.

* s3api: delete orphaned chunks only when the entry is confirmed absent

A failed create no longer skips verification based on the error class: the filer can fail after inserting the entry (issue #11387) and a partially-applied routed transaction can leave it behind too, both surfacing as definitive errors. Every failed create now resolves the entry's fate, and the uploaded chunks are deleted only when the entry is confirmed absent; anything unverifiable keeps them for vacuum.

* s3api: confirm absence on every filer the create could have committed on

A lock-path create fails over across filers, so the entry can live on a replica the routed owner has not caught up to; one not-found does not prove absence. The confirmation now queries the owner, the prior owner, and the failover set, declaring absent only when none of them has the entry.

* s3api: bound the reconciliation lookups confirmCreateLanded runs

The lookups ran on context.Background() under the object write lock, so a connected filer that never replies could stall the write path. One timeout now covers the whole enumeration; an expired budget fails the remaining lookups as uncertain, which keeps the chunks.

2026-09-18 12:30:07 -07:00

cors

go fmt

2026-01-28 14:34:07 -08:00

iceberg

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

lance

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

lifecycle_xml

admin: add bucket lifecycle rule editing (#10860 )

2026-08-21 23:42:26 -07:00

policy

chore(weed/s3api/policy): prune unused test functions (#9150 )

2026-04-20 12:04:41 -07:00

policy_engine

s3api: configurable trusted-proxy allowlist for aws:SourceIp (#11302 ) (#11315 )

2026-09-14 13:54:26 -07:00

s3_constants

feat(s3api): add bucket quota S3 extension via ?seaweedfs-quota (#11279 )

2026-09-11 22:17:30 -07:00

s3_objectlock

s3: check Object Lock on directory-marker keys before bucket deletion (#11096 )

2026-09-02 11:35:19 -07:00

s3bucket

s3: reject reserved bucket name "filemeta" (#9760 )

2026-05-31 11:15:05 -07:00

s3err

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3lifecycle

admin: add bucket lifecycle rule editing (#10860 )

2026-08-21 23:42:26 -07:00

s3tables

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

AmazonS3.xsd

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

auth_account_collapse_test.go

s3: register an identity's inline account instead of collapsing it into admin (#10548 )

2026-08-03 12:45:42 -07:00

auth_audit_requester_test.go

fix(s3api/audit): surface OIDC identity claim in audit log for STS sessions (#11269 )

2026-09-11 11:29:46 -07:00

auth_config_default_deny_test.go

s3: deny anonymous access when the identity config loads no identities (#10954 )

2026-08-25 15:31:32 -07:00

auth_copy_source_test.go

s3api: verify source permission on CopyObject and UploadPartCopy (#9555 )

2026-05-18 21:35:53 -07:00

auth_credentials_native_floor_test.go

iam: preserve native Admin when IAM policies are attached (#11226 ) (#11232 )

2026-09-08 14:39:43 -07:00

auth_credentials_policy_document_test.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

auth_credentials_policy_document.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

auth_credentials_policy_sync_test.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

auth_credentials_static_config_test.go

fix(s3api/iam): avoid transient AccessDenied from full reloads on single IAM file changes (#11271 )

2026-09-11 10:42:19 -07:00

auth_credentials_subscribe_test.go

fix(s3api/iam): avoid transient AccessDenied from full reloads on single IAM file changes (#11271 )

2026-09-11 10:42:19 -07:00

auth_credentials_subscribe.go

fix(s3api/iam): avoid transient AccessDenied from full reloads on single IAM file changes (#11271 )

2026-09-11 10:42:19 -07:00

auth_credentials_trust.go

Add AssumeRole and AssumeRoleWithLDAPIdentity STS actions (#8003 )

2026-01-12 10:45:24 -08:00

auth_credentials.go

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

auth_jwt_streaming_unsigned_test.go

fix(s3): authenticate JWT unsigned-streaming uploads (#9729 )

2026-05-28 18:10:24 -07:00

auth_presigned_semicolon_test.go

s3: accept raw semicolons in query strings (#10305 )

2026-07-10 12:17:35 -07:00

auth_proxy_integration_test.go

s3: verify SigV4 against each plausible reverse-proxy host (#10284 )

2026-07-09 02:34:13 -07:00

auth_prune_bucket_test.go

s3: embedded IAM inline policy honors prefix-scoped resources (#10192 )

2026-07-02 09:14:54 -07:00

auth_security_test.go

s3: keep verifying the request host when externalUrl is set (#10970 )

2026-08-26 10:09:05 -07:00

auth_signature_v2_test.go

fix(s3): verify SigV2 using percent-encoded path for Unicode object keys (#10022 )

2026-06-20 08:28:40 -07:00

auth_signature_v2.go

s3: log each request at -v=2 (#10931 )

2026-08-24 18:39:30 -07:00

auth_signature_v4_sts_test.go

s3: give STS sessions a distinct owner account instead of admin (#9963 )

2026-06-14 13:55:11 -07:00

auth_signature_v4_test.go

s3: keep verifying the request host when externalUrl is set (#10970 )

2026-08-26 10:09:05 -07:00

auth_signature_v4_unsigned_headers_test.go

security(s3api): reject unsigned x-amz-* headers in SigV4 requests (#9121 )

2026-04-17 12:20:28 -07:00

auth_signature_v4.go

s3: reject virtual-host bucket retargeting via X-Forwarded-Host (#11281 )

2026-09-11 22:23:26 -07:00

auth_sts_identity_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

auth_sts_session_token_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

auth_sts_v4_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

auto_signature_v4_test.go

s3: reject virtual-host bucket retargeting via X-Forwarded-Host (#11281 )

2026-09-11 22:23:26 -07:00

bucket_metadata_test.go

Add codespell support with configuration and typo fixes (#10393 )

2026-07-22 14:38:06 -07:00

bucket_metadata.go

s3: report the effective ownership when a bucket has none stored (#10591 )

2026-08-05 13:15:28 -07:00

bucket_owner_identity_test.go

s3: honor a bucket owner recorded as an identity (#10567 )

2026-08-04 16:00:04 -07:00

bucket_paths.go

Lance catalog, and a Rust plugin worker to maintain it (#10841 )

2026-08-19 22:59:56 -07:00

bucket_size_metrics_test.go

s3: take bucket sizes from the master's summary (#10664 )

2026-08-09 00:00:19 -07:00

bucket_size_metrics.go

s3: take bucket sizes from the master's summary (#10664 )

2026-08-09 00:00:19 -07:00

chunked_bug_reproduction_test.go

S3 API: unsigned streaming (no cred) but chunks contain signatures (#7118 )

2025-08-11 10:31:01 -07:00

chunked_reader_v4_test.go

fix(s3api): normalize checksum trailer header names (#9905 )

2026-06-10 00:30:43 -07:00

chunked_reader_v4.go

fix(s3api): normalize checksum trailer header names (#9905 )

2026-06-10 00:30:43 -07:00

copy_source_decode_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

crc_combine_test.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

crc_combine.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

credential_iam_errors.go

fix(s3api,iamapi): avoid full SaveConfiguration when creating a single IAM user (#9261 )

2026-05-01 01:14:15 -07:00

custom_types.go

chore(weed/s3api): prune dead code (#10462 )

2026-07-27 17:48:20 -07:00

filer_multipart_abort_test.go

s3: abort completed multipart uploads metadata-only (#11385 )

2026-09-18 01:01:52 -07:00

filer_multipart_checksum_test.go

s3: return the multipart object checksum in the CompleteMultipartUpload response (#11101 )

2026-09-02 11:57:45 -07:00

filer_multipart_etag_test.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

filer_multipart_sse_s3_test.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

filer_multipart.go

s3: abort completed multipart uploads metadata-only (#11385 )

2026-09-18 01:01:52 -07:00

filer_util_delete_test.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

filer_util_list_retry_test.go

Classify a filer error before a user-controlled path is wrapped into it (#11004 )

2026-08-27 22:30:53 -07:00

filer_util_tags.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

filer_util.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

iam_batch_delete_test.go

s3: add the RenameObject endpoint (#10659 )

2026-08-08 21:24:30 -07:00

iam_defaults_test.go

Fix IAM defaults and S3Tables IAM regression (#8374 )

2026-02-18 18:20:03 -08:00

iam_list_prefix_regression_test.go

fix(s3api): keep ListBucket resource ARN at bucket level (#9792 )

2026-06-02 14:45:45 -07:00

iam_optional_test.go

fix(s3): keep anonymous access working with EnableIam default (fixes #9557 ) (#9567 )

2026-05-19 13:03:30 -07:00

identity_reflection_test.go

Enforce IAM for S3 Tables bucket creation (#8388 )

2026-02-19 22:52:05 -08:00

object_lock_utils.go

fix(s3api): clear stale object lock years (#9890 )

2026-06-09 00:48:38 -07:00

README.txt

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

request_body_test.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

request_body.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3_action_resolver_test.go

s3: close list-type / ownership-controls routing mismatch (#11280 )

2026-09-11 22:21:58 -07:00

s3_action_resolver.go

s3: close list-type / ownership-controls routing mismatch (#11280 )

2026-09-11 22:21:58 -07:00

s3_bucket_encryption.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3_content_encoding_test.go

S3: Fix Content-Encoding header not preserved (#7894 ) (#7895 )

2025-12-27 12:25:33 -08:00

s3_encodepath_test.go

s3api: optimize encodePath memory allocations (#10252 )

2026-07-07 12:36:47 -07:00

s3_end_to_end_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3_error_utils.go

Classify a filer error before a user-controlled path is wrapped into it (#11004 )

2026-08-27 22:30:53 -07:00

s3_existing_object_tag_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3_granular_action_security_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_iam_bearer_trust_policy_test.go

s3: enforce role trust policy on direct OIDC bearer authentication (#10302 )

2026-07-10 12:14:18 -07:00

s3_iam_group_role_abac_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3_iam_middleware.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3_iam_role_selection_test.go

S3 API: Advanced IAM System (#7160 )

2025-08-30 11:15:48 -07:00

s3_jwt_auth_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3_list_parts_action_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_metadata_util.go

s3: do not persist multi part "Response-Content-Disposition" in request header (#7887 )

2025-12-26 13:21:15 -08:00

s3_sse_c.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3_sse_ctr_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_kms_utils.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3_sse_kms.go

chore(weed/s3api): prune dead code (#10462 )

2026-07-27 17:48:20 -07:00

s3_sse_metadata.go

fix(s3api): cross-SSE copy operations and bring them back into CI (#9281 ) (#9282 )

2026-04-29 10:06:51 -07:00

s3_sse_s3_integration_test.go

fix(s3api): stream multipart-SSE chunks lazily to avoid truncated GETs (#8908 ) (#9228 )

2026-04-26 16:31:42 -07:00

s3_sse_s3_kek_passphrase_test.go

fix(s3): encrypt SSE-S3 KEK at rest with AES-GCM wrapping (#8880 )

2026-05-04 19:21:41 -07:00

s3_sse_s3_multipart_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_s3.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

s3_sse_test_utils_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_utils.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_token_differentiation_test.go

fix: comprehensive go vet error fixes and add CI enforcement (#7861 )

2025-12-23 14:48:50 -08:00

s3_validation_utils_require_test.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3_validation_utils.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3api_acl_helper.go

s3: honor a bucket owner recorded as an identity (#10567 )

2026-08-04 16:00:04 -07:00

s3api_acp.go

s3: give account-less identities a distinct owner instead of admin (#9962 )

2026-06-14 13:54:49 -07:00

s3api_ambiguous_subresource_test.go

s3: close list-type / ownership-controls routing mismatch (#11280 )

2026-09-11 22:21:58 -07:00

s3api_auth.go

Fix critical authentication bypass vulnerability (#7912 ) (#7915 )

2025-12-30 12:40:59 -08:00

s3api_bucket_config_stubs_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_config_stubs.go

feat(s3): stub bucket configuration list endpoints (#9571 )

2026-05-19 17:34:51 -07:00

s3api_bucket_config_update_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_config.go

Fixes from the review of the admin bucket policy UI (#10907 )

2026-08-24 00:52:01 -07:00

s3api_bucket_cors_handlers.go

S3: add fallback for CORS (#7404 )

2025-10-29 13:43:27 -07:00

s3api_bucket_handlers_list_test.go

s3: list the buckets an attached IAM policy grants (#10458 )

2026-07-27 16:42:01 -07:00

s3api_bucket_handlers_misc_test.go

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

s3api_bucket_handlers_misc.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3api_bucket_handlers_object_lock_config.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_bucket_handlers.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3api_bucket_lifecycle_config.go

admin: add bucket lifecycle rule editing (#10860 )

2026-08-21 23:42:26 -07:00

s3api_bucket_lifecycle_fastpath_warn_test.go

s3: warn when a lifecycle change leaves fast-path-stamped objects on their old TTL (#11184 )

2026-09-05 12:13:37 -07:00

s3api_bucket_lifecycle_fastpath_warn.go

s3: warn when a lifecycle change leaves fast-path-stamped objects on their old TTL (#11184 )

2026-09-05 12:13:37 -07:00

s3api_bucket_lifecycle_response_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_metadata_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_bucket_owner_index_test.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

s3api_bucket_owner_index.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_bucket_policy_arn_test.go

s3api: fix AccessDenied by correctly propagating principal ARN in vended tokens (#8330 )

2026-02-12 23:11:41 -08:00

s3api_bucket_policy_authz_test.go

s3: require a bucket-policy action to write a bucket policy (#10444 )

2026-07-26 00:52:22 -07:00

s3api_bucket_policy_engine.go

s3api: configurable trusted-proxy allowlist for aws:SourceIp (#11302 ) (#11315 )

2026-09-14 13:54:26 -07:00

s3api_bucket_policy_handlers.go

Fixes from the review of the admin bucket policy UI (#10907 )

2026-08-24 00:52:01 -07:00

s3api_bucket_policy_identity_deny_test.go

s3: bucket-policy Allow must not override an identity explicit Deny (#11256 )

2026-09-09 20:15:43 -07:00

s3api_bucket_policy_mirror_test.go

Fixes from the review of the admin bucket policy UI (#10907 )

2026-08-24 00:52:01 -07:00

s3api_bucket_quota_handlers_test.go

feat(s3api): add bucket quota S3 extension via ?seaweedfs-quota (#11279 )

2026-09-11 22:17:30 -07:00

s3api_bucket_quota_handlers.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3api_bucket_subresource_routing_test.go

s3: allow-unordered is a listing parameter, not an unimplemented subresource (#10846 )

2026-08-19 20:09:23 -07:00

s3api_bucket_tagging_handlers.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_chunk_manifest_test.go

filer: pack SSE chunks into manifests (#11175 )

2026-09-05 10:16:17 -07:00

s3api_chunk_manifest.go

filer: guard FoundationDB 100KB value limit and pack earlier (#11161 )

2026-09-04 23:12:27 -07:00

s3api_circuit_breaker_test.go

s3api: add optional request interceptor to circuit breaker (#9994 )

2026-06-16 16:29:30 -07:00

s3api_circuit_breaker.go

s3api: add optional request interceptor to circuit breaker (#9994 )

2026-06-16 16:29:30 -07:00

s3api_copy_size_calculation.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3api_copy_source_classify_test.go

s3: return NoSuchKey/NoSuchBucket for a missing CopyObject source (#10332 )

2026-07-14 11:53:53 -07:00

s3api_copy_validation.go

fix(s3api): preserve requested AES256 copy encryption (#10049 )

2026-06-22 22:19:24 -07:00

s3api_directory_marker.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_domain_test.go

fix: Use a mixed of virtual and path styles within a single subdomain (#7357 )

2025-10-24 01:45:22 -07:00

s3api_embedded_iam_authz_test.go

iam: bind CreateServiceAccount ParentUser to the caller (#11218 )

2026-09-07 20:25:03 -07:00

s3api_embedded_iam_oidc.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

s3api_embedded_iam_test.go

s3: embedded IAM inline policy honors prefix-scoped resources (#10192 )

2026-07-02 09:14:54 -07:00

s3api_embedded_iam_user_tags_test.go

feat(s3): add TagUser, UntagUser, ListUserTags IAM actions (#9572 )

2026-05-19 17:35:44 -07:00

s3api_embedded_iam.go

iam: bind CreateServiceAccount ParentUser to the caller (#11218 )

2026-09-07 20:25:03 -07:00

s3api_encrypted_volume_copy_test.go

s3: fix UploadPartCopy with volume-data encryption (#10971 )

2026-08-26 10:05:49 -07:00

s3api_governance_permissions_test.go

s3: enforce dedicated Object Lock actions (#11362 )

2026-09-16 20:34:06 -07:00

s3api_handlers_failover_test.go

master, filer, s3api: bound the collection deletes that strand a caller (#11026 )

2026-08-28 16:32:30 -07:00

s3api_handlers.go

master, filer, s3api: bound the collection deletes that strand a caller (#11026 )

2026-08-28 16:32:30 -07:00

s3api_head_bucket_test.go

s3: distinguish a failed bucket lookup from a missing bucket on HEAD (#11000 )

2026-08-27 22:26:15 -07:00

s3api_iam_oidc_test.go

feat(iam): OIDC provider mutations + multi-client + TLS thumbprints (Phase 2b) (#9320 )

2026-05-05 11:26:08 -07:00

s3api_iceberg_credentials_test.go

iceberg: vend table-scoped credentials to clients that ask for delegation (#10777 )

2026-08-16 12:57:12 -07:00

s3api_iceberg_credentials.go

iceberg: vend table-scoped credentials to clients that ask for delegation (#10777 )

2026-08-16 12:57:12 -07:00

s3api_implicit_directory_test.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_inline_policy_condition_test.go

fix(s3api): evaluate aws:SourceIp from the direct TCP peer, not forwarded headers (#11231 )

2026-09-08 15:09:31 -07:00

s3api_internal_lifecycle_test.go

s3: gate internal LifecycleDelete gRPC behind admin Bearer auth (#11291 )

2026-09-13 13:07:10 -07:00

s3api_internal_lifecycle.go

s3: abort completed multipart uploads metadata-only (#11385 )

2026-09-18 01:01:52 -07:00

s3api_list_normalization_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_list_parts_no_such_upload_test.go

s3: ListParts on a completed or unknown upload answers NoSuchUpload (#11081 )

2026-09-02 12:05:16 -07:00

s3api_local_read_fallback_test.go

S3: commit GET status only after the first read succeeds (#10930 )

2026-08-24 16:14:52 -07:00

s3api_multipart_path_validation_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_multipart_ssekms_test.go

fix(s3api): stream multipart-SSE chunks lazily to avoid truncated GETs (#8908 ) (#9228 )

2026-04-26 16:31:42 -07:00

s3api_multipart_upload_entry_test.go

s3: an abort answered mid-part no longer leaves the upload completable (#11025 )

2026-08-28 16:12:09 -07:00

s3api_nextmarker_test.go

fix: S3 listing NextMarker missing intermediate directory component (#8089 )

2026-01-22 16:56:35 -08:00

s3api_object_handlers_acl_test.go

Fix object tagging writing back to the wrong object for nested keys (#10338 )

2026-07-15 02:31:51 -07:00

s3api_object_handlers_acl.go

Fix object tagging writing back to the wrong object for nested keys (#10338 )

2026-07-15 02:31:51 -07:00

s3api_object_handlers_attributes.go

S3: fold large chunk lists into manifest chunks on the direct write path (#10383 )

2026-07-21 00:08:05 -07:00

s3api_object_handlers_conditional_read_test.go

s3: keep a missing object a 404 under If-Match and If-Unmodified-Since (#10985 )

2026-08-27 11:56:33 -07:00

s3api_object_handlers_copy_alloc_test.go

fix(s3api): cap copy-chunk receive buffer to avoid append-grow blowup (#9420 )

2026-05-10 12:08:06 -07:00

s3api_object_handlers_copy_bench_test.go

feat(s3api): full-chunk gzip pass-through skips volume-side decompress (#9427 )

2026-05-10 14:55:59 -07:00

s3api_object_handlers_copy_checksum_test.go

s3: return the multipart object checksum in the CompleteMultipartUpload response (#11101 )

2026-09-02 11:57:45 -07:00

s3api_object_handlers_copy_chunk_upload_test.go

fix: cap pool retention so chunk-copy buffers don't hoard memory (#9422 )

2026-05-10 13:34:25 -07:00

s3api_object_handlers_copy_collection_test.go

s3: place multipart part chunks by the destination object's storage rule (#10845 )

2026-08-19 20:07:57 -07:00

s3api_object_handlers_copy_etag_test.go

s3: fix UploadPartCopy with volume-data encryption (#10971 )

2026-08-26 10:05:49 -07:00

s3api_object_handlers_copy_mime_test.go

fix(s3api): preserve requested AES256 copy encryption (#10049 )

2026-06-22 22:19:24 -07:00

s3api_object_handlers_copy_part_sse.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_object_handlers_copy_self_reuse_test.go

s3: give a versioned metadata-only copy its own chunks (#10594 )

2026-08-05 20:29:28 -07:00

s3api_object_handlers_copy_stream.go

Add codespell support with configuration and typo fixes (#10393 )

2026-07-22 14:38:06 -07:00

s3api_object_handlers_copy_unified.go

s3: give a versioned metadata-only copy its own chunks (#10594 )

2026-08-05 20:29:28 -07:00

s3api_object_handlers_copy.go

s3: return the multipart object checksum in the CompleteMultipartUpload response (#11101 )

2026-09-02 11:57:45 -07:00

s3api_object_handlers_delete_test.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_object_handlers_delete.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_object_handlers_dir_test.go

S3: let a key that is a prefix of other keys be an object (#10912 )

2026-08-24 15:10:34 -07:00

s3api_object_handlers_legal_hold.go

adjust logs

2026-01-17 18:40:48 -08:00

s3api_object_handlers_list_deleted_prefix_test.go

s3: a key deleted after enabling versioning must leave the listing (#10684 )

2026-08-10 11:04:06 -07:00

s3api_object_handlers_list_directory_marker_test.go

s3: stop treating a directory marker as a versioned object (#10573 )

2026-08-05 00:24:54 -07:00

s3api_object_handlers_list_directory_test.go

s3: keep listing when empty directories fill the listing window (#10280 )

2026-07-09 00:22:34 -07:00

s3api_object_handlers_list_marker_before_prefix_test.go

s3: a list marker that sorts before the prefix excludes nothing (#11322 )

2026-09-15 16:50:58 -07:00

s3api_object_handlers_list_test.go

s3: a list marker that sorts before the prefix excludes nothing (#11322 )

2026-09-15 16:50:58 -07:00

s3api_object_handlers_list_versioned_test.go

s3: keep the list marker exclusive for versioned objects (#10496 )

2026-07-30 12:57:31 -07:00

s3api_object_handlers_list.go

s3: a list marker that sorts before the prefix excludes nothing (#11322 )

2026-09-15 16:50:58 -07:00

s3api_object_handlers_multipart.go

s3: return the multipart object checksum in the CompleteMultipartUpload response (#11101 )

2026-09-02 11:57:45 -07:00

s3api_object_handlers_postpolicy_authz_test.go

s3: route per-key object authorization through a shared helper (#11072 )

2026-09-01 13:20:20 -07:00

s3api_object_handlers_postpolicy_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_handlers_postpolicy.go

s3: preserve versions for POST policy uploads (#11316 )

2026-09-14 16:36:45 -07:00

s3api_object_handlers_put_ambiguous_test.go

s3api: delete orphaned chunks only when the entry is confirmed absent (#11389 )

2026-09-18 12:30:07 -07:00

s3api_object_handlers_put_checksum_test.go

fix(s3): honor ChecksumAlgorithm on presigned URL uploads (#9076 )

2026-04-14 21:52:49 -07:00

s3api_object_handlers_put_chunksize_test.go

s3: chunk uploads at the filer's maxMB (#10439 )

2026-07-25 11:30:02 -07:00

s3api_object_handlers_put_error_test.go

s3: report a peer that went away as ClientDisconnected, not IncompleteBody (#10511 )

2026-07-31 19:43:45 -07:00

s3api_object_handlers_put.go

s3api: delete orphaned chunks only when the entry is confirmed absent (#11389 )

2026-09-18 12:30:07 -07:00

s3api_object_handlers_rename_test.go

s3: make RenameObject idempotent for a retried request (#11178 )

2026-09-05 11:48:42 -07:00

s3api_object_handlers_rename.go

s3: make RenameObject idempotent for a retried request (#11178 )

2026-09-05 11:48:42 -07:00

s3api_object_handlers_retention.go

refactor (#6999 )

2025-07-19 00:49:56 -07:00

s3api_object_handlers_tagging.go

Fix object tagging writing back to the wrong object for nested keys (#10338 )

2026-07-15 02:31:51 -07:00

s3api_object_handlers.go

filer: pack SSE chunks into manifests (#11175 )

2026-09-05 10:16:17 -07:00

s3api_object_lifecycle_ttl_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_lifecycle_ttl.go

feat(s3api): apply lifecycle TTL at write time (#9377 )

2026-05-08 21:35:27 -07:00

s3api_object_lock_actions_authz_test.go

s3: enforce dedicated Object Lock actions (#11362 )

2026-09-16 20:34:06 -07:00

s3api_object_lock_authz_test.go

s3: separate Object Lock configuration permission (#11361 )

2026-09-16 15:27:09 -07:00

s3api_object_lock_fix_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_lock_headers_test.go

Test object lock and retention (#6997 )

2025-07-18 22:25:58 -07:00

s3api_object_ownership_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_part_number_test.go

s3: HeadObject with partNumber returns the part's size and 206 (#11166 )

2026-09-04 23:10:41 -07:00

s3api_object_range_test.go

s3api: reject malformed Range offsets (#10034 )

2026-06-22 07:52:01 -07:00

s3api_object_retention_test.go

fix(s3api): clear stale object lock years (#9890 )

2026-06-09 00:48:38 -07:00

s3api_object_retention.go

s3: enforce dedicated Object Lock actions (#11362 )

2026-09-16 20:34:06 -07:00

s3api_object_routed_read_test.go

s3: route object reads to the key's owner filer (#9806 )

2026-06-03 00:12:28 -07:00

s3api_object_routed_read.go

s3api: delete orphaned chunks only when the entry is confirmed absent (#11389 )

2026-09-18 12:30:07 -07:00

s3api_object_routed_write_test.go

s3: commit multipart upload and remove .uploads atomically; purge completed uploads metadata-only (#11375 )

2026-09-17 21:09:21 -07:00

s3api_object_routed_write.go

s3: commit multipart upload and remove .uploads atomically; purge completed uploads metadata-only (#11375 )

2026-09-17 21:09:21 -07:00

s3api_object_versioned_finalize.go

s3: commit multipart upload and remove .uploads atomically; purge completed uploads metadata-only (#11375 )

2026-09-17 21:09:21 -07:00

s3api_object_versioning_list_prefix_test.go

s3api: push the listing prefix down to the filer in ListObjectVersions (#11070 )

2026-09-01 10:37:52 -07:00

s3api_object_versioning_lookup_retry_test.go

s3api: stop retrying a definitive NotFound in getLatestObjectVersion (#11067 )

2026-09-01 10:11:09 -07:00

s3api_object_versioning_self_heal_test.go

fix(s3): recover versioned reads when the .versions latest pointer is absent (#9782 )

2026-06-01 20:01:30 -07:00

s3api_object_versioning.go

s3api: push the listing prefix down to the filer in ListObjectVersions (#11070 )

2026-09-01 10:37:52 -07:00

s3api_part_boundary_test.go

S3: fold large chunk lists into manifest chunks on the direct write path (#10383 )

2026-07-21 00:08:05 -07:00

s3api_path_validation_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_path_validation.go

s3: close list-type / ownership-controls routing mismatch (#11280 )

2026-09-11 22:21:58 -07:00

s3api_put_handlers.go

Prune Unused Functions from weed/s3api (#8815 )

2026-03-28 13:24:11 -07:00

s3api_put_object_helper_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3api_put_object_helper.go

s3api: remove redundant auth verification in getRequestDataReader (#7685 )

2025-12-09 10:24:35 -08:00

s3api_remote_storage_test.go

make the remote-mount cache wait configurable per mount (#11168 )

2026-09-04 23:50:11 -07:00

s3api_remote_versioned_path_test.go

s3: validate the version-id header used as a filer path segment (#11097 )

2026-09-02 11:36:58 -07:00

s3api_server_advertise_test.go

s3: register the advertised ip with the master (#10482 )

2026-07-29 10:30:46 -07:00

s3api_server_grpc_test.go

s3: gate IAM-cache gRPC RPCs behind admin Bearer auth (#11190 )

2026-09-06 12:21:51 -07:00

s3api_server_grpc.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3api_server_routing_test.go

iam: bind CreateServiceAccount ParentUser to the caller (#11218 )

2026-09-07 20:25:03 -07:00

s3api_server.go

s3: drop implicit reader cache budget that throttled S3 GETs (#11384 )

2026-09-18 01:02:32 -07:00

s3api_sosapi.go

master: let VolumeList ask for the volumes it wants (#10674 )

2026-08-09 21:59:42 -07:00

s3api_sse_decrypt_test.go

fix(s3api): backfill multipart SSE-S3 metadata at completion (#9224 )

2026-04-25 23:06:37 -07:00

s3api_sse_s3_upload_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_sse_stream_status_test.go

S3: commit SSE GET status only after the first read succeeds (#10935 )

2026-08-24 18:36:46 -07:00

s3api_status_handlers.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_stream_error_test.go

Client disconnects create context cancelled errors, 500x errors and Filer lookup failures (#8845 )

2026-03-30 12:11:30 -07:00

s3api_sts_assume_role_admin_scope_test.go

s3: keep an admin's role session scoped to the role (#10520 )

2026-07-31 19:50:59 -07:00

s3api_sts_assume_role_arn_shape_test.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

s3api_sts_assume_role_authz_test.go

sts: enforce session-policy explicit deny during role chaining (#10103 )

2026-06-24 21:38:21 -07:00

s3api_sts_assume_role_dispatch_test.go

fix(iam): four phase-3 follow-ups (provider scoping, public path wrapper, static mirror, claim-mode RoleArn) (#9333 )

2026-05-05 19:14:44 -07:00

s3api_sts_assume_role_empty_arn_test.go

fix(iam): four phase-3 follow-ups (provider scoping, public path wrapper, static mirror, claim-mode RoleArn) (#9333 )

2026-05-05 19:14:44 -07:00

s3api_sts_assume_role_test.go

Embed role policies in AssumeRole STS tokens (#8421 )

2026-02-23 22:59:53 -08:00

s3api_sts_audit_routing_test.go

s3: cover three untested STS paths (#10521 )

2026-07-31 23:56:04 -07:00

s3api_sts_duration_test.go

fix(s3api/sts): respect MaxSessionLength config in DurationSeconds validation (#11267 )

2026-09-10 23:03:32 -07:00

s3api_sts_get_caller_identity_handler_test.go

s3: cover three untested STS paths (#10521 )

2026-07-31 23:56:04 -07:00

s3api_sts_get_caller_identity_test.go

STS: add GetCallerIdentity support (#8893 )

2026-04-02 15:59:09 -07:00

s3api_sts_get_federation_token_test.go

feat(s3): add STS GetFederationToken support (#8891 )

2026-04-02 17:37:05 -07:00

s3api_sts_web_identity_http_test.go

s3: cover three untested STS paths (#10521 )

2026-07-31 23:56:04 -07:00

s3api_sts.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3api_tables_auth_test.go

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

s3api_tables_maintenance_rest_test.go

s3tables: add the maintenance configuration APIs (#10773 )

2026-08-16 10:36:59 -07:00

s3api_tables_rest_validation_test.go

s3tables: allow hyphens in namespace and table names (#10093 )

2026-06-24 16:24:45 -07:00

s3api_tables_routing_test.go

fix(s3): stop S3 Tables routes from swallowing buckets named "buckets" or "get-table" (#9566 )

2026-05-19 14:24:25 -07:00

s3api_tables.go

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

s3api_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_version_id_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_version_id.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_versioning_heal_log_test.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_versioning_reconciler_test.go

s3: share one retry allowance across a batch delete (#11001 )

2026-08-27 22:28:25 -07:00

s3api_versioning_reconciler.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_xsd_generated_helper.go

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3api_xsd_generated.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

sses3_multipart_repro_test.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

stats_test.go

fix(s3/audit): emit audit log for successful GET/HEAD (#9467 )

2026-05-13 09:24:59 -07:00

stats.go

s3: log each request at -v=2 (#10931 )

2026-08-24 18:39:30 -07:00

sts_packed_policy_test.go

feat(iam): STS web-identity AWS-fidelity polish (Phase 1) (#9318 )

2026-05-04 22:10:49 -07:00

sts_params_test.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

sts_session_name_test.go

feat(iam): STS web-identity AWS-fidelity polish (Phase 1) (#9318 )

2026-05-04 22:10:49 -07:00

tags_test.go

s3api: preserve equals signs in tag values (#10058 )

2026-06-23 01:25:32 -07:00

tags.go

s3api: preserve equals signs in tag values (#10058 )

2026-06-23 01:25:32 -07:00

README.txt

see https://blog.aqwari.net/xml-schema-go/

1. go get aqwari.net/xml/cmd/xsdgen
2. Add EncodingType element for ListBucketResult in AmazonS3.xsd
3. xsdgen -o s3api_xsd_generated.go -pkg s3api AmazonS3.xsd
4. Remove empty Grantee struct in s3api_xsd_generated.go
5. Remove xmlns: sed s'/http:\/\/s3.amazonaws.com\/doc\/2006-03-01\/\ //' s3api_xsd_generated.go