seaweedfs

Github-Mirror/seaweedfs

0 Fork 0

mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-10-07 14:57:48 +02:00

Files

T

History

Joel Town RoadandChris Lu 079a7d8ba3 s3: give each prefix its own hidden-prefix probe budget (#11626 )

* s3: give each prefix its own hidden-prefix probe budget

The shared cursor.probedEntries counter in dirHoldsOnlyHiddenEntries was
exhausted by one large all-deleted subtree, causing every later prefix in
the same request to be treated as visible.  The fix allocates a fresh
budget (hiddenProbePerPrefixBudget, default 1000) for each top-level call
and threads it down to recursive calls via a pointer, so cross-prefix
budget bleed is impossible.

Fixes #10847.

* s3: keep 10000 probe budget, now per prefix

Restore hiddenProbeBudget = 10000 as a package const (not a mutable var)
applied per-prefix instead of per-request. The override hook moves to an
unexported probeBudget field on ListingCursor; zero means use the package
default. Tests set probeBudget: 3 on the cursor, keeping them fast without
touching package state. Also revert the unrelated uint32 cast on the
ListEntries Limit field.

* s3: cap total hidden-prefix probe work per listing request

The per-prefix budget resets for every candidate prefix, but deleted
prefixes do not spend maxKeys, so a page can walk an unbounded number of
them. Keep a request-wide probedEntries ceiling (hiddenProbeTotalBudget,
10x the per-prefix budget) so total probe work stays bounded.

* s3api: pin the probe-budget cutoff and the request-wide ceiling

---------

Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>

2026-10-07 20:53:39 +08:00

cors

go fmt

2026-01-28 14:34:07 -08:00

iceberg

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

lance

lance: authenticate the catalog with Bearer tokens and x-api-key (#11431 )

2026-09-24 07:02:59 +08:00

lifecycle_xml

admin: add bucket lifecycle rule editing (#10860 )

2026-08-21 23:42:26 -07:00

policy

chore(weed/s3api/policy): prune unused test functions (#9150 )

2026-04-20 12:04:41 -07:00

policy_engine

s3api: persist ACLs on PutObject uploads (#11592 )

2026-10-05 09:13:19 +08:00

s3_constants

s3: accept x-amz-checksum-mode from the query string, case-insensitively

2026-09-20 01:15:11 -07:00

s3_objectlock

s3: check Object Lock on directory-marker keys before bucket deletion (#11096 )

2026-09-02 11:35:19 -07:00

s3bucket

s3: reject reserved bucket name "filemeta" (#9760 )

2026-05-31 11:15:05 -07:00

s3err

fix(s3): initialize destination ACLs for CopyObject (#11599 )

2026-10-05 18:22:16 +08:00

s3lifecycle

admin: add bucket lifecycle rule editing (#10860 )

2026-08-21 23:42:26 -07:00

s3tables

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

AmazonS3.xsd

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

auth_account_collapse_test.go

s3: register an identity's inline account instead of collapsing it into admin (#10548 )

2026-08-03 12:45:42 -07:00

auth_audit_requester_test.go

s3: record requester identity before the authz verdict (#11479 )

2026-09-27 07:03:01 +08:00

auth_config_default_deny_test.go

s3: deny anonymous access when the identity config loads no identities (#10954 )

2026-08-25 15:31:32 -07:00

auth_copy_source_test.go

s3api: verify source permission on CopyObject and UploadPartCopy (#9555 )

2026-05-18 21:35:53 -07:00

auth_credentials_native_floor_test.go

s3: do not promote ?prefix into the object for non-List actions (#11494 )

2026-09-28 07:17:58 +08:00

auth_credentials_policy_document_test.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

auth_credentials_policy_document.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

auth_credentials_policy_sync_test.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

auth_credentials_static_config_test.go

fix(s3api/iam): avoid transient AccessDenied from full reloads on single IAM file changes (#11271 )

2026-09-11 10:42:19 -07:00

auth_credentials_subscribe_test.go

fix(s3api/iam): avoid transient AccessDenied from full reloads on single IAM file changes (#11271 )

2026-09-11 10:42:19 -07:00

auth_credentials_subscribe.go

s3/iam: manage roles through the IAM API, with an opt-in persistent role store (#11522 )

2026-09-30 20:45:47 +08:00

auth_credentials_trust.go

Add AssumeRole and AssumeRoleWithLDAPIdentity STS actions (#8003 )

2026-01-12 10:45:24 -08:00

auth_credentials.go

s3api: persist ACLs on PutObject uploads (#11592 )

2026-10-05 09:13:19 +08:00

auth_jwt_streaming_unsigned_test.go

fix(s3): authenticate JWT unsigned-streaming uploads (#9729 )

2026-05-28 18:10:24 -07:00

auth_presigned_semicolon_test.go

s3: accept raw semicolons in query strings (#10305 )

2026-07-10 12:17:35 -07:00

auth_proxy_integration_test.go

s3: verify SigV4 against each plausible reverse-proxy host (#10284 )

2026-07-09 02:34:13 -07:00

auth_prune_bucket_test.go

s3: embedded IAM inline policy honors prefix-scoped resources (#10192 )

2026-07-02 09:14:54 -07:00

auth_security_test.go

s3: do not promote ?prefix into the object for non-List actions (#11494 )

2026-09-28 07:17:58 +08:00

auth_signature_v2_test.go

fix(s3): verify SigV2 using percent-encoded path for Unicode object keys (#10022 )

2026-06-20 08:28:40 -07:00

auth_signature_v2.go

s3: log each request at -v=2 (#10931 )

2026-08-24 18:39:30 -07:00

auth_signature_v4_sts_test.go

s3: give STS sessions a distinct owner account instead of admin (#9963 )

2026-06-14 13:55:11 -07:00

auth_signature_v4_test.go

s3: keep verifying the request host when externalUrl is set (#10970 )

2026-08-26 10:09:05 -07:00

auth_signature_v4_unsigned_headers_test.go

s3api: allow unsigned SSE-C customer key headers on presigned requests (#11578 )

2026-10-03 12:33:52 +08:00

auth_signature_v4.go

s3api: allow unsigned SSE-C customer key headers on presigned requests (#11578 )

2026-10-03 12:33:52 +08:00

auth_sts_identity_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

auth_sts_session_token_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

auth_sts_v4_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

auto_signature_v4_test.go

s3: reject virtual-host bucket retargeting via X-Forwarded-Host (#11281 )

2026-09-11 22:23:26 -07:00

bucket_metadata_test.go

Add codespell support with configuration and typo fixes (#10393 )

2026-07-22 14:38:06 -07:00

bucket_metadata.go

s3: report the effective ownership when a bucket has none stored (#10591 )

2026-08-05 13:15:28 -07:00

bucket_owner_identity_test.go

s3: honor a bucket owner recorded as an identity (#10567 )

2026-08-04 16:00:04 -07:00

bucket_paths.go

Lance catalog, and a Rust plugin worker to maintain it (#10841 )

2026-08-19 22:59:56 -07:00

bucket_size_metrics_test.go

s3: take bucket sizes from the master's summary (#10664 )

2026-08-09 00:00:19 -07:00

bucket_size_metrics.go

s3: take bucket sizes from the master's summary (#10664 )

2026-08-09 00:00:19 -07:00

chunked_bug_reproduction_test.go

S3 API: unsigned streaming (no cred) but chunks contain signatures (#7118 )

2025-08-11 10:31:01 -07:00

chunked_reader_trailer_split_test.go

s3api: copy the trailer checksum before reading the next trailer line (#11583 )

2026-10-04 01:14:15 +08:00

chunked_reader_v4_test.go

fix(s3api): normalize checksum trailer header names (#9905 )

2026-06-10 00:30:43 -07:00

chunked_reader_v4.go

s3api: copy the trailer checksum before reading the next trailer line (#11583 )

2026-10-04 01:14:15 +08:00

copy_source_decode_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

crc_combine_test.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

crc_combine.go

s3api: FULL_OBJECT checksums for CRC multipart uploads (#10236 )

2026-07-05 20:19:20 -07:00

credential_iam_errors.go

fix(s3api,iamapi): avoid full SaveConfiguration when creating a single IAM user (#9261 )

2026-05-01 01:14:15 -07:00

custom_types.go

chore(weed/s3api): prune dead code (#10462 )

2026-07-27 17:48:20 -07:00

filer_multipart_abort_test.go

s3: abort completed multipart uploads metadata-only (#11385 )

2026-09-18 01:01:52 -07:00

filer_multipart_checksum_test.go

s3: return the multipart object checksum in the CompleteMultipartUpload response (#11101 )

2026-09-02 11:57:45 -07:00

filer_multipart_etag_test.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

filer_multipart_sse_s3_test.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

filer_multipart.go

s3api: exclude marker part in listObjectParts pagination (#11463 )

2026-09-26 11:58:23 +08:00

filer_util_delete_test.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

filer_util_list_retry_test.go

Classify a filer error before a user-controlled path is wrapped into it (#11004 )

2026-08-27 22:30:53 -07:00

filer_util_tags.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

filer_util.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

iam_batch_delete_test.go

s3: add the RenameObject endpoint (#10659 )

2026-08-08 21:24:30 -07:00

iam_defaults_test.go

s3/iam: manage roles through the IAM API, with an opt-in persistent role store (#11522 )

2026-09-30 20:45:47 +08:00

iam_list_prefix_regression_test.go

s3: keep a listing's start position inside the requested prefix (#11493 )

2026-09-28 06:58:44 +08:00

iam_optional_test.go

fix(s3): keep anonymous access working with EnableIam default (fixes #9557 ) (#9567 )

2026-05-19 13:03:30 -07:00

identity_reflection_test.go

Enforce IAM for S3 Tables bucket creation (#8388 )

2026-02-19 22:52:05 -08:00

object_lock_utils.go

fix(s3api): clear stale object lock years (#9890 )

2026-06-09 00:48:38 -07:00

README.txt

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

request_body_test.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

request_body.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3_action_resolver_test.go

s3: keep dedicated object-lock actions pinned during action resolution (#11475 )

2026-09-26 21:42:34 +08:00

s3_action_resolver.go

s3api: persist ACLs on PutObject uploads (#11592 )

2026-10-05 09:13:19 +08:00

s3_bucket_encryption.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3_content_encoding_test.go

s3api: do not store aws-chunked in an object's Content-Encoding (#11528 )

2026-10-01 01:10:38 +08:00

s3_encodepath_test.go

s3api: optimize encodePath memory allocations (#10252 )

2026-07-07 12:36:47 -07:00

s3_end_to_end_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3_error_utils.go

Classify a filer error before a user-controlled path is wrapped into it (#11004 )

2026-08-27 22:30:53 -07:00

s3_existing_object_tag_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3_granular_action_security_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_iam_bearer_trust_policy_test.go

s3: enforce role trust policy on direct OIDC bearer authentication (#10302 )

2026-07-10 12:14:18 -07:00

s3_iam_group_role_abac_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3_iam_middleware.go

s3: do not promote ?prefix into the object for non-List actions (#11494 )

2026-09-28 07:17:58 +08:00

s3_iam_role_selection_test.go

S3 API: Advanced IAM System (#7160 )

2025-08-30 11:15:48 -07:00

s3_jwt_auth_test.go

s3: tighten STS session token handling (#11383 )

2026-09-17 23:50:16 -07:00

s3_list_parts_action_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_metadata_util.go

s3api: do not store aws-chunked in an object's Content-Encoding (#11528 )

2026-10-01 01:10:38 +08:00

s3_sse_c.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3_sse_ctr_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_kms_utils.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3_sse_kms.go

chore(weed/s3api): prune dead code (#10462 )

2026-07-27 17:48:20 -07:00

s3_sse_metadata.go

fix(s3api): cross-SSE copy operations and bring them back into CI (#9281 ) (#9282 )

2026-04-29 10:06:51 -07:00

s3_sse_s3_integration_test.go

fix(s3api): stream multipart-SSE chunks lazily to avoid truncated GETs (#8908 ) (#9228 )

2026-04-26 16:31:42 -07:00

s3_sse_s3_kek_passphrase_test.go

fix(s3): encrypt SSE-S3 KEK at rest with AES-GCM wrapping (#8880 )

2026-05-04 19:21:41 -07:00

s3_sse_s3_multipart_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_s3.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

s3_sse_test_utils_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_utils.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_token_differentiation_test.go

fix: comprehensive go vet error fixes and add CI enforcement (#7861 )

2025-12-23 14:48:50 -08:00

s3_validation_utils_require_test.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3_validation_utils.go

fix(s3): add HMAC-SHA256 key commitment to SSE-S3 and SSE-KMS (#8879 )

2026-05-04 19:14:41 -07:00

s3api_acl_header_parser_test.go

s3api: persist ACLs on PutObject uploads (#11592 )

2026-10-05 09:13:19 +08:00

s3api_acl_helper.go

s3api: persist ACLs on PutObject uploads (#11592 )

2026-10-05 09:13:19 +08:00

s3api_acp.go

s3: give account-less identities a distinct owner instead of admin (#9962 )

2026-06-14 13:54:49 -07:00

s3api_ambiguous_subresource_test.go

s3: close seaweedfs-quota policy-confusion gap (#11409 )

2026-09-20 23:34:57 -07:00

s3api_auth.go

Fix critical authentication bypass vulnerability (#7912 ) (#7915 )

2025-12-30 12:40:59 -08:00

s3api_bucket_config_stubs_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_config_stubs.go

feat(s3): stub bucket configuration list endpoints (#9571 )

2026-05-19 17:34:51 -07:00

s3api_bucket_config_update_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_config.go

Fixes from the review of the admin bucket policy UI (#10907 )

2026-08-24 00:52:01 -07:00

s3api_bucket_cors_handlers.go

S3: add fallback for CORS (#7404 )

2025-10-29 13:43:27 -07:00

s3api_bucket_delete_test.go

s3: ignore empty intermediate directories in bucketHasUserObjects (#11490 ) (#11491 )

2026-09-28 06:56:46 +08:00

s3api_bucket_handlers_list_test.go

s3: list the buckets an attached IAM policy grants (#10458 )

2026-07-27 16:42:01 -07:00

s3api_bucket_handlers_misc_test.go

s3: evaluate bucket policy before ACL public-read for anonymous requests (#11471 )

2026-09-26 17:59:57 +08:00

s3api_bucket_handlers_misc.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3api_bucket_handlers_object_lock_config.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_bucket_handlers.go

fix(s3): honor object ACLs for anonymous GET and HEAD (#11605 )

2026-10-06 09:52:37 +08:00

s3api_bucket_lifecycle_config.go

admin: add bucket lifecycle rule editing (#10860 )

2026-08-21 23:42:26 -07:00

s3api_bucket_lifecycle_fastpath_warn_test.go

s3: warn when a lifecycle change leaves fast-path-stamped objects on their old TTL (#11184 )

2026-09-05 12:13:37 -07:00

s3api_bucket_lifecycle_fastpath_warn.go

s3: warn when a lifecycle change leaves fast-path-stamped objects on their old TTL (#11184 )

2026-09-05 12:13:37 -07:00

s3api_bucket_lifecycle_response_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_bucket_metadata_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_bucket_owner_index_test.go

s3: paginate ListBuckets and serve it from a bucket owner index (#10214 )

2026-07-02 21:11:41 -07:00

s3api_bucket_owner_index.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_bucket_policy_arn_test.go

s3api: fix AccessDenied by correctly propagating principal ARN in vended tokens (#8330 )

2026-02-12 23:11:41 -08:00

s3api_bucket_policy_authz_test.go

s3: require a bucket-policy action to write a bucket policy (#10444 )

2026-07-26 00:52:22 -07:00

s3api_bucket_policy_engine.go

s3api: persist ACLs on PutObject uploads (#11592 )

2026-10-05 09:13:19 +08:00

s3api_bucket_policy_handlers.go

Fixes from the review of the admin bucket policy UI (#10907 )

2026-08-24 00:52:01 -07:00

s3api_bucket_policy_identity_deny_test.go

s3: bucket-policy Allow must not override an identity explicit Deny (#11256 )

2026-09-09 20:15:43 -07:00

s3api_bucket_policy_mirror_test.go

Fixes from the review of the admin bucket policy UI (#10907 )

2026-08-24 00:52:01 -07:00

s3api_bucket_quota_handlers_test.go

feat(s3api): add bucket quota S3 extension via ?seaweedfs-quota (#11279 )

2026-09-11 22:17:30 -07:00

s3api_bucket_quota_handlers.go

s3: drain request body before error response (#11334 )

2026-09-15 13:09:07 -07:00

s3api_bucket_subresource_routing_test.go

s3: allow-unordered is a listing parameter, not an unimplemented subresource (#10846 )

2026-08-19 20:09:23 -07:00

s3api_bucket_tagging_handlers.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_chunk_manifest_test.go

filer: pack SSE chunks into manifests (#11175 )

2026-09-05 10:16:17 -07:00

s3api_chunk_manifest.go

filer: guard FoundationDB 100KB value limit and pack earlier (#11161 )

2026-09-04 23:12:27 -07:00

s3api_circuit_breaker_test.go

s3api: add optional request interceptor to circuit breaker (#9994 )

2026-06-16 16:29:30 -07:00

s3api_circuit_breaker.go

s3api: add optional request interceptor to circuit breaker (#9994 )

2026-06-16 16:29:30 -07:00

s3api_copy_size_calculation.go

chore: remove ~50k lines of unreachable dead code (#8913 )

2026-04-03 16:04:27 -07:00

s3api_copy_source_classify_test.go

s3: return NoSuchKey/NoSuchBucket for a missing CopyObject source (#10332 )

2026-07-14 11:53:53 -07:00

s3api_copy_validation.go

fix(s3api): preserve requested AES256 copy encryption (#10049 )

2026-06-22 22:19:24 -07:00

s3api_directory_marker.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_domain_test.go

fix: Use a mixed of virtual and path styles within a single subdomain (#7357 )

2025-10-24 01:45:22 -07:00

s3api_embedded_iam_authz_test.go

iam: bind CreateServiceAccount ParentUser to the caller (#11218 )

2026-09-07 20:25:03 -07:00

s3api_embedded_iam_oidc.go

s3/iam: persist IAM-managed OIDC providers in the filer, and trust them after a restart (#11510 )

2026-09-29 11:51:39 +08:00

s3api_embedded_iam_role.go

s3/iam: manage roles through the IAM API, with an opt-in persistent role store (#11522 )

2026-09-30 20:45:47 +08:00

s3api_embedded_iam_test.go

s3: embedded IAM inline policy honors prefix-scoped resources (#10192 )

2026-07-02 09:14:54 -07:00

s3api_embedded_iam_user_tags_test.go

feat(s3): add TagUser, UntagUser, ListUserTags IAM actions (#9572 )

2026-05-19 17:35:44 -07:00

s3api_embedded_iam.go

s3/iam: manage roles through the IAM API, with an opt-in persistent role store (#11522 )

2026-09-30 20:45:47 +08:00

s3api_encrypted_volume_copy_test.go

s3: fix UploadPartCopy with volume-data encryption (#10971 )

2026-08-26 10:05:49 -07:00

s3api_governance_permissions_test.go

s3: enforce dedicated Object Lock actions (#11362 )

2026-09-16 20:34:06 -07:00

s3api_handlers_failover_test.go

master, filer, s3api: bound the collection deletes that strand a caller (#11026 )

2026-08-28 16:32:30 -07:00

s3api_handlers.go

master, filer, s3api: bound the collection deletes that strand a caller (#11026 )

2026-08-28 16:32:30 -07:00

s3api_head_bucket_test.go

s3: distinguish a failed bucket lookup from a missing bucket on HEAD (#11000 )

2026-08-27 22:26:15 -07:00

s3api_iam_oidc_test.go

s3/iam: persist IAM-managed OIDC providers in the filer, and trust them after a restart (#11510 )

2026-09-29 11:51:39 +08:00

s3api_iam_role_test.go

s3/iam: manage roles through the IAM API, with an opt-in persistent role store (#11522 )

2026-09-30 20:45:47 +08:00

s3api_iceberg_credentials_test.go

iceberg: vend table-scoped credentials to clients that ask for delegation (#10777 )

2026-08-16 12:57:12 -07:00

s3api_iceberg_credentials.go

iceberg: vend table-scoped credentials to clients that ask for delegation (#10777 )

2026-08-16 12:57:12 -07:00

s3api_implicit_directory_test.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_inline_policy_condition_test.go

fix(s3api): evaluate aws:SourceIp from the direct TCP peer, not forwarded headers (#11231 )

2026-09-08 15:09:31 -07:00

s3api_internal_lifecycle_test.go

s3: restrict admin gRPC to local callers when no signing key (#11530 )

2026-10-01 23:12:23 +08:00

s3api_internal_lifecycle.go

s3: abort completed multipart uploads metadata-only (#11385 )

2026-09-18 01:01:52 -07:00

s3api_list_normalization_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_list_parts_no_such_upload_test.go

s3api: exclude marker part in listObjectParts pagination (#11463 )

2026-09-26 11:58:23 +08:00

s3api_local_read_fallback_test.go

S3: commit GET status only after the first read succeeds (#10930 )

2026-08-24 16:14:52 -07:00

s3api_multipart_path_validation_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_multipart_ssekms_test.go

fix(s3api): stream multipart-SSE chunks lazily to avoid truncated GETs (#8908 ) (#9228 )

2026-04-26 16:31:42 -07:00

s3api_multipart_upload_entry_test.go

s3: an abort answered mid-part no longer leaves the upload completable (#11025 )

2026-08-28 16:12:09 -07:00

s3api_nextmarker_test.go

fix: S3 listing NextMarker missing intermediate directory component (#8089 )

2026-01-22 16:56:35 -08:00

s3api_object_acl_permissions_test.go

s3api: fix PutObjectAcl permission scoping and owner grants (#11587 )

2026-10-04 19:41:10 +08:00

s3api_object_anonymous_cache_test.go

fix(s3): recheck cache metadata and validate null objects (#11618 )

2026-10-06 14:25:43 +08:00

s3api_object_anonymous_read_test.go

fix(s3): honor object ACLs for anonymous GET and HEAD (#11605 )

2026-10-06 09:52:37 +08:00

s3api_object_anonymous_read.go

fix(s3): honor object ACLs for anonymous GET and HEAD (#11605 )

2026-10-06 09:52:37 +08:00

s3api_object_handlers_acl_test.go

Fix object tagging writing back to the wrong object for nested keys (#10338 )

2026-07-15 02:31:51 -07:00

s3api_object_handlers_acl.go

s3api: fix PutObjectAcl permission scoping and owner grants (#11587 )

2026-10-04 19:41:10 +08:00

s3api_object_handlers_attributes_test.go

s3api: report the stored checksum in GetObjectAttributes (#11529 )

2026-10-01 01:11:19 +08:00

s3api_object_handlers_attributes.go

s3api: report the stored checksum in GetObjectAttributes (#11529 )

2026-10-01 01:11:19 +08:00

s3api_object_handlers_conditional_read_test.go

s3: keep a missing object a 404 under If-Match and If-Unmodified-Since (#10985 )

2026-08-27 11:56:33 -07:00

s3api_object_handlers_copy_acl_test.go

fix(s3): initialize destination ACLs for CopyObject (#11599 )

2026-10-05 18:22:16 +08:00

s3api_object_handlers_copy_alloc_test.go

fix(s3api): cap copy-chunk receive buffer to avoid append-grow blowup (#9420 )

2026-05-10 12:08:06 -07:00

s3api_object_handlers_copy_bench_test.go

feat(s3api): full-chunk gzip pass-through skips volume-side decompress (#9427 )

2026-05-10 14:55:59 -07:00

s3api_object_handlers_copy_checksum_test.go

S3: quote ETag in CopyObject and UploadPartCopy XML responses (#11624 )

2026-10-06 18:05:15 +08:00

s3api_object_handlers_copy_chunk_upload_test.go

fix: cap pool retention so chunk-copy buffers don't hoard memory (#9422 )

2026-05-10 13:34:25 -07:00

s3api_object_handlers_copy_collection_test.go

s3: place multipart part chunks by the destination object's storage rule (#10845 )

2026-08-19 20:07:57 -07:00

s3api_object_handlers_copy_etag_test.go

S3: quote ETag in CopyObject and UploadPartCopy XML responses (#11624 )

2026-10-06 18:05:15 +08:00

s3api_object_handlers_copy_mime_test.go

fix(s3api): preserve requested AES256 copy encryption (#10049 )

2026-06-22 22:19:24 -07:00

s3api_object_handlers_copy_part_sse.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_object_handlers_copy_self_reuse_test.go

s3: give a versioned metadata-only copy its own chunks (#10594 )

2026-08-05 20:29:28 -07:00

s3api_object_handlers_copy_stream.go

Add codespell support with configuration and typo fixes (#10393 )

2026-07-22 14:38:06 -07:00

s3api_object_handlers_copy_unified.go

s3: give a versioned metadata-only copy its own chunks (#10594 )

2026-08-05 20:29:28 -07:00

s3api_object_handlers_copy.go

S3: quote ETag in CopyObject and UploadPartCopy XML responses (#11624 )

2026-10-06 18:05:15 +08:00

s3api_object_handlers_delete_test.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_object_handlers_delete.go

s3: replay a delete whose reply the transport dropped (#11022 )

2026-08-28 14:30:21 -07:00

s3api_object_handlers_dir_test.go

S3: let a key that is a prefix of other keys be an object (#10912 )

2026-08-24 15:10:34 -07:00

s3api_object_handlers_legal_hold.go

adjust logs

2026-01-17 18:40:48 -08:00

s3api_object_handlers_list_deleted_prefix_test.go

s3: give each prefix its own hidden-prefix probe budget (#11626 )

2026-10-07 20:53:39 +08:00

s3api_object_handlers_list_directory_marker_test.go

s3: stop treating a directory marker as a versioned object (#10573 )

2026-08-05 00:24:54 -07:00

s3api_object_handlers_list_directory_test.go

s3: keep listing when empty directories fill the listing window (#10280 )

2026-07-09 00:22:34 -07:00

s3api_object_handlers_list_marker_before_prefix_test.go

s3: keep a listing's start position inside the requested prefix (#11493 )

2026-09-28 06:58:44 +08:00

s3api_object_handlers_list_test.go

S3: fix ListObjectVersions losing keys across page boundaries (#11598 )

2026-10-05 11:58:04 +08:00

s3api_object_handlers_list_versioned_test.go

S3: fix ListObjectVersions losing keys across page boundaries (#11598 )

2026-10-05 11:58:04 +08:00

s3api_object_handlers_list.go

s3: give each prefix its own hidden-prefix probe budget (#11626 )

2026-10-07 20:53:39 +08:00

s3api_object_handlers_multipart.go

s3: require dedicated object-lock permissions for x-amz-object-lock-* headers (#11492 )

2026-09-27 20:17:12 +08:00

s3api_object_handlers_postpolicy_authz_test.go

s3: route per-key object authorization through a shared helper (#11072 )

2026-09-01 13:20:20 -07:00

s3api_object_handlers_postpolicy_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_handlers_postpolicy.go

s3: require dedicated object-lock permissions for x-amz-object-lock-* headers (#11492 )

2026-09-27 20:17:12 +08:00

s3api_object_handlers_put_ambiguous_test.go

s3api: delete orphaned chunks only when the entry is confirmed absent (#11389 )

2026-09-18 12:30:07 -07:00

s3api_object_handlers_put_checksum_test.go

fix(s3): honor ChecksumAlgorithm on presigned URL uploads (#9076 )

2026-04-14 21:52:49 -07:00

s3api_object_handlers_put_chunksize_test.go

s3: chunk uploads at the filer's maxMB (#10439 )

2026-07-25 11:30:02 -07:00

s3api_object_handlers_put_error_test.go

s3: return 403, not 500, when an over-quota bucket refuses a write (#11552 )

2026-10-01 22:21:03 +08:00

s3api_object_handlers_put.go

S3: quote ETag in CopyObject and UploadPartCopy XML responses (#11624 )

2026-10-06 18:05:15 +08:00

s3api_object_handlers_readonly_test.go

s3: return 403, not 500, when an over-quota bucket refuses a write (#11552 )

2026-10-01 22:21:03 +08:00

s3api_object_handlers_rename_test.go

s3: make RenameObject idempotent for a retried request (#11178 )

2026-09-05 11:48:42 -07:00

s3api_object_handlers_rename.go

s3: make RenameObject idempotent for a retried request (#11178 )

2026-09-05 11:48:42 -07:00

s3api_object_handlers_retention.go

refactor (#6999 )

2025-07-19 00:49:56 -07:00

s3api_object_handlers_tagging.go

Fix object tagging writing back to the wrong object for nested keys (#10338 )

2026-07-15 02:31:51 -07:00

s3api_object_handlers.go

fix(s3): recheck cache metadata and validate null objects (#11618 )

2026-10-06 14:25:43 +08:00

s3api_object_lifecycle_ttl_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_lifecycle_ttl.go

feat(s3api): apply lifecycle TTL at write time (#9377 )

2026-05-08 21:35:27 -07:00

s3api_object_lock_actions_authz_test.go

s3: require dedicated object-lock permissions for x-amz-object-lock-* headers (#11492 )

2026-09-27 20:17:12 +08:00

s3api_object_lock_authz_test.go

s3: separate Object Lock configuration permission (#11361 )

2026-09-16 15:27:09 -07:00

s3api_object_lock_fix_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_lock_headers_test.go

s3: require dedicated object-lock permissions for x-amz-object-lock-* headers (#11492 )

2026-09-27 20:17:12 +08:00

s3api_object_ownership_test.go

s3: lazy, bounded, entry-free per-bucket caches (#10213 )

2026-07-02 21:11:34 -07:00

s3api_object_part_number_test.go

s3: HeadObject with partNumber returns the part's size and 206 (#11166 )

2026-09-04 23:10:41 -07:00

s3api_object_range_test.go

s3api: reject malformed Range offsets (#10034 )

2026-06-22 07:52:01 -07:00

s3api_object_retention_test.go

fix(s3api): clear stale object lock years (#9890 )

2026-06-09 00:48:38 -07:00

s3api_object_retention.go

s3: enforce dedicated Object Lock actions (#11362 )

2026-09-16 20:34:06 -07:00

s3api_object_routed_read_test.go

s3: route object reads to the key's owner filer (#9806 )

2026-06-03 00:12:28 -07:00

s3api_object_routed_read.go

s3api: delete orphaned chunks only when the entry is confirmed absent (#11389 )

2026-09-18 12:30:07 -07:00

s3api_object_routed_write_test.go

s3: commit multipart upload and remove .uploads atomically; purge completed uploads metadata-only (#11375 )

2026-09-17 21:09:21 -07:00

s3api_object_routed_write.go

fix(s3): initialize destination ACLs for CopyObject (#11599 )

2026-10-05 18:22:16 +08:00

s3api_object_upload_acl_test.go

fix(s3): initialize destination ACLs for CopyObject (#11599 )

2026-10-05 18:22:16 +08:00

s3api_object_upload_acl.go

fix(s3): initialize destination ACLs for CopyObject (#11599 )

2026-10-05 18:22:16 +08:00

s3api_object_versioned_finalize.go

s3: commit multipart upload and remove .uploads atomically; purge completed uploads metadata-only (#11375 )

2026-09-17 21:09:21 -07:00

s3api_object_versioning_heal_test.go

fix(s3): make self-heal pointer persist CAS-bound against concurrent writers (#11627 )

2026-10-07 20:04:09 +08:00

s3api_object_versioning_list_prefix_test.go

s3api: push the listing prefix down to the filer in ListObjectVersions (#11070 )

2026-09-01 10:37:52 -07:00

s3api_object_versioning_lookup_retry_test.go

s3api: stop retrying a definitive NotFound in getLatestObjectVersion (#11067 )

2026-09-01 10:11:09 -07:00

s3api_object_versioning_pagination_test.go

S3: fix ListObjectVersions losing keys across page boundaries (#11598 )

2026-10-05 11:58:04 +08:00

s3api_object_versioning_self_heal_test.go

fix(s3): recover versioned reads when the .versions latest pointer is absent (#9782 )

2026-06-01 20:01:30 -07:00

s3api_object_versioning.go

fix(s3): make self-heal pointer persist CAS-bound against concurrent writers (#11627 )

2026-10-07 20:04:09 +08:00

s3api_part_boundary_test.go

S3: fold large chunk lists into manifest chunks on the direct write path (#10383 )

2026-07-21 00:08:05 -07:00

s3api_path_validation_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_path_validation.go

s3: close seaweedfs-quota policy-confusion gap (#11409 )

2026-09-20 23:34:57 -07:00

s3api_put_handlers.go

Prune Unused Functions from weed/s3api (#8815 )

2026-03-28 13:24:11 -07:00

s3api_put_object_helper_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3api_put_object_helper.go

s3api: remove redundant auth verification in getRequestDataReader (#7685 )

2025-12-09 10:24:35 -08:00

s3api_remote_storage_test.go

make the remote-mount cache wait configurable per mount (#11168 )

2026-09-04 23:50:11 -07:00

s3api_remote_versioned_path_test.go

s3: validate the version-id header used as a filer path segment (#11097 )

2026-09-02 11:36:58 -07:00

s3api_server_advertise_test.go

s3: register the advertised ip with the master (#10482 )

2026-07-29 10:30:46 -07:00

s3api_server_grpc_test.go

s3: restrict admin gRPC to local callers when no signing key (#11530 )

2026-10-01 23:12:23 +08:00

s3api_server_grpc.go

s3: restrict admin gRPC to local callers when no signing key (#11530 )

2026-10-01 23:12:23 +08:00

s3api_server_routing_test.go

iam: bind CreateServiceAccount ParentUser to the caller (#11218 )

2026-09-07 20:25:03 -07:00

s3api_server.go

fix(s3): honor object ACLs for anonymous GET and HEAD (#11605 )

2026-10-06 09:52:37 +08:00

s3api_sosapi.go

master: let VolumeList ask for the volumes it wants (#10674 )

2026-08-09 21:59:42 -07:00

s3api_sse_decrypt_test.go

fix(s3api): backfill multipart SSE-S3 metadata at completion (#9224 )

2026-04-25 23:06:37 -07:00

s3api_sse_s3_upload_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_sse_stream_status_test.go

S3: commit SSE GET status only after the first read succeeds (#10935 )

2026-08-24 18:36:46 -07:00

s3api_status_handlers.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_stream_error_test.go

Client disconnects create context cancelled errors, 500x errors and Filer lookup failures (#8845 )

2026-03-30 12:11:30 -07:00

s3api_sts_assume_role_admin_scope_test.go

s3: keep an admin's role session scoped to the role (#10520 )

2026-07-31 19:50:59 -07:00

s3api_sts_assume_role_arn_shape_test.go

s3api: load document-style policies from the advanced IAM config (#10481 )

2026-07-29 10:30:30 -07:00

s3api_sts_assume_role_authz_test.go

sts: enforce session-policy explicit deny during role chaining (#10103 )

2026-06-24 21:38:21 -07:00

s3api_sts_assume_role_dispatch_test.go

fix(iam): four phase-3 follow-ups (provider scoping, public path wrapper, static mirror, claim-mode RoleArn) (#9333 )

2026-05-05 19:14:44 -07:00

s3api_sts_assume_role_empty_arn_test.go

fix(iam): four phase-3 follow-ups (provider scoping, public path wrapper, static mirror, claim-mode RoleArn) (#9333 )

2026-05-05 19:14:44 -07:00

s3api_sts_assume_role_test.go

s3/iam: manage roles through the IAM API, with an opt-in persistent role store (#11522 )

2026-09-30 20:45:47 +08:00

s3api_sts_audit_routing_test.go

s3: cover three untested STS paths (#10521 )

2026-07-31 23:56:04 -07:00

s3api_sts_duration_test.go

fix(s3api/sts): respect MaxSessionLength config in DurationSeconds validation (#11267 )

2026-09-10 23:03:32 -07:00

s3api_sts_get_caller_identity_handler_test.go

s3: cover three untested STS paths (#10521 )

2026-07-31 23:56:04 -07:00

s3api_sts_get_caller_identity_test.go

STS: add GetCallerIdentity support (#8893 )

2026-04-02 15:59:09 -07:00

s3api_sts_get_federation_token_test.go

feat(s3): add STS GetFederationToken support (#8891 )

2026-04-02 17:37:05 -07:00

s3api_sts_web_identity_http_test.go

s3: cover three untested STS paths (#10521 )

2026-07-31 23:56:04 -07:00

s3api_sts.go

s3/iam: manage roles through the IAM API, with an opt-in persistent role store (#11522 )

2026-09-30 20:45:47 +08:00

s3api_tables_auth_test.go

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

s3api_tables_maintenance_rest_test.go

s3tables: add the maintenance configuration APIs (#10773 )

2026-08-16 10:36:59 -07:00

s3api_tables_rest_validation_test.go

s3tables: allow hyphens in namespace and table names (#10093 )

2026-06-24 16:24:45 -07:00

s3api_tables_routing_test.go

fix(s3): stop S3 Tables routes from swallowing buckets named "buckets" or "get-table" (#9566 )

2026-05-19 14:24:25 -07:00

s3api_tables.go

s3api: unify auth error handling across s3tables, iceberg and lance (#11381 )

2026-09-18 01:01:04 -07:00

s3api_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_version_id_test.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_version_id.go

[s3] validate indirect filer path inputs (#9931 )

2026-06-11 21:56:16 -07:00

s3api_versioning_heal_log_test.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_versioning_reconciler_test.go

s3: share one retry allowance across a batch delete (#11001 )

2026-08-27 22:28:25 -07:00

s3api_versioning_reconciler.go

feat(s3/versioning): grep-able heal logs + scan-anomaly diagnostics + audit cmd (#9468 )

2026-05-13 10:48:58 -07:00

s3api_xml_timestamp_test.go

s3api: always write XML timestamps with three fractional digits (#11520 )

2026-09-30 16:22:31 +08:00

s3api_xsd_generated_helper.go

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3api_xsd_generated.go

s3api: always write XML timestamps with three fractional digits (#11520 )

2026-09-30 16:22:31 +08:00

sses3_multipart_repro_test.go

mount: version open file handles by filer log position (#10403 )

2026-07-23 17:44:02 -07:00

stats_test.go

fix(s3/audit): emit audit log for successful GET/HEAD (#9467 )

2026-05-13 09:24:59 -07:00

stats.go

s3: log each request at -v=2 (#10931 )

2026-08-24 18:39:30 -07:00

sts_packed_policy_test.go

feat(iam): STS web-identity AWS-fidelity polish (Phase 1) (#9318 )

2026-05-04 22:10:49 -07:00

sts_params_test.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

sts_session_name_test.go

feat(iam): STS web-identity AWS-fidelity polish (Phase 1) (#9318 )

2026-05-04 22:10:49 -07:00

tags_test.go

s3api: preserve equals signs in tag values (#10058 )

2026-06-23 01:25:32 -07:00

tags.go

s3api: preserve equals signs in tag values (#10058 )

2026-06-23 01:25:32 -07:00

README.txt

see https://blog.aqwari.net/xml-schema-go/

1. go get aqwari.net/xml/cmd/xsdgen
2. Add EncodingType element for ListBucketResult in AmazonS3.xsd
3. xsdgen -o s3api_xsd_generated.go -pkg s3api AmazonS3.xsd
4. Remove empty Grantee struct in s3api_xsd_generated.go
5. Remove xmlns: sed s'/http:\/\/s3.amazonaws.com\/doc\/2006-03-01\/\ //' s3api_xsd_generated.go