seaweedfs

0 Fork 0

mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-10-08 07:17:48 +02:00

Files

T

Chris Lu 0f5c6a8ae0 fix S3 conditional header TOCTOU race during concurrent writes (#8800 )

The early check in checkConditionalHeaders ran before data upload,
allowing concurrent requests to all pass before any write completed.

Use the existing distributed lock manager to atomically re-check
conditional headers and create the filer entry. The lock is acquired
after data upload (so it's held only for fast metadata operations)
and covers all conditional headers: If-Match, If-None-Match,
If-Modified-Since, and If-Unmodified-Since.

Requests without conditional headers have zero overhead (no lock).

2026-03-27 12:42:57 -07:00

cors

go fmt

2026-01-28 14:34:07 -08:00

iceberg

filer: add structured error codes to CreateEntryResponse (#8767 )

2026-03-24 17:08:22 -07:00

policy

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

policy_engine

S3: add s3: prefix to x-amz-* condition keys for AWS compatibility (#8765 )

2026-03-24 14:04:42 -07:00

s3_constants

S3: fix silent PutObject failure and enforce 1024-byte key limit (#8764 )

2026-03-24 13:35:28 -07:00

s3_objectlock

mount: make metadata cache rebuilds snapshot-consistent (#8531 )

2026-03-07 09:19:40 -08:00

s3bucket

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3err

S3: fix silent PutObject failure and enforce 1024-byte key limit (#8764 )

2026-03-24 13:35:28 -07:00

s3tables

filer: add conditional update preconditions (#8647 )

2026-03-16 12:33:32 -07:00

AmazonS3.xsd

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

auth_credentials_subscribe_test.go

go fmt

2026-02-20 18:40:47 -08:00

auth_credentials_subscribe.go

fix: resolve CORS cache race condition causing stale 404 responses (#8748 )

2026-03-23 19:33:20 -07:00

auth_credentials_test.go

fix(s3): omit NotResource:null from bucket policy JSON response (#8658 )

2026-03-16 12:58:26 -07:00

auth_credentials_trust.go

Add AssumeRole and AssumeRoleWithLDAPIdentity STS actions (#8003 )

2026-01-12 10:45:24 -08:00

auth_credentials.go

fix(s3): allow deleting the anonymous user from admin webui (#8706 )

2026-03-19 18:10:20 -07:00

auth_proxy_integration_test.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

auth_security_test.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

auth_signature_v2_test.go

fix(s3api): fix AWS Signature V2 format and validation (#7488 )

2025-11-26 12:24:02 -08:00

auth_signature_v2.go

s3: enforce authentication and JSON error format for Iceberg REST Catalog (#8192 )

2026-02-03 11:55:12 -08:00

auth_signature_v4_sts_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

auth_signature_v4_test.go

fix(s3api): correctly extract host header port in extractHostHeader (#8464 )

2026-02-27 13:41:45 -08:00

auth_signature_v4.go

fix(s3api): correctly extract host header port in extractHostHeader (#8464 )

2026-02-27 13:41:45 -08:00

auth_sts_identity_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

auth_sts_v4_test.go

Fix AWS SDK Signature V4 with STS credentials (issue #7941 ) (#7944 )

2026-01-03 10:09:59 -08:00

auto_signature_v4_test.go

Fix S3 signature verification behind reverse proxies (#8444 )

2026-02-26 14:20:42 -08:00

bucket_metadata_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

bucket_metadata.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

bucket_paths.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

bucket_size_metrics.go

Make lock_manager.RenewInterval configurable in LiveLock (#7830 )

2025-12-20 15:25:47 -08:00

chunked_bug_reproduction_test.go

S3 API: unsigned streaming (no cred) but chunks contain signatures (#7118 )

2025-08-11 10:31:01 -07:00

chunked_reader_v4_test.go

IAM: Add Service Account Support (#7744 ) (#7901 )

2025-12-29 20:17:23 -08:00

chunked_reader_v4.go

s3: support STREAMING-AWS4-HMAC-SHA256-PAYLOAD-TRAILER for signed chunked uploads with checksums (#7623 )

2025-12-04 14:51:37 -08:00

copy_source_decode_test.go

s3: use url.PathUnescape for X-Amz-Copy-Source header (#8545 )

2026-03-07 11:10:02 -08:00

custom_types.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

filer_multipart_test.go

s3api: fix multipart Complete ETag matching and lower empty-upload log noise (#8264 )

2026-02-09 11:45:57 -08:00

filer_multipart.go

fix S3 conditional header TOCTOU race during concurrent writes (#8800 )

2026-03-27 12:42:57 -07:00

filer_util_delete_test.go

Fix S3 delete for non-empty directory markers (#8740 )

2026-03-23 13:35:16 -07:00

filer_util_tags.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

filer_util.go

Fix S3 delete for non-empty directory markers (#8740 )

2026-03-23 13:35:16 -07:00

iam_defaults_test.go

Fix IAM defaults and S3Tables IAM regression (#8374 )

2026-02-18 18:20:03 -08:00

iam_optional_test.go

fix(s3): allow deleting the anonymous user from admin webui (#8706 )

2026-03-19 18:10:20 -07:00

identity_reflection_test.go

Enforce IAM for S3 Tables bucket creation (#8388 )

2026-02-19 22:52:05 -08:00

object_lock_utils.go

Fix SeaweedFS S3 bucket extended attributes handling (#7854 )

2025-12-22 23:19:50 -08:00

README.txt

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3_action_resolver_test.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3_action_resolver.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3_bucket_encryption.go

fix(s3api): return no-encryption instead of error when bucket metadata is missing

2026-03-11 13:49:21 -07:00

s3_content_encoding_test.go

S3: Fix Content-Encoding header not preserved (#7894 ) (#7895 )

2025-12-27 12:25:33 -08:00

s3_end_to_end_test.go

Add AssumeRole and AssumeRoleWithLDAPIdentity STS actions (#8003 )

2026-01-12 10:45:24 -08:00

s3_error_utils.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3_existing_object_tag_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3_granular_action_security_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_iam_middleware.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_iam_role_selection_test.go

S3 API: Advanced IAM System (#7160 )

2025-08-30 11:15:48 -07:00

s3_iam_simple_test.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_jwt_auth_test.go

feat(s3api): Implement S3 Policy Variables (#8039 )

2026-01-16 11:12:28 -08:00

s3_list_parts_action_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_metadata_util.go

s3: do not persist multi part "Response-Content-Disposition" in request header (#7887 )

2025-12-26 13:21:15 -08:00

s3_multipart_iam_test.go

Allow multipart upload operations when s3:PutObject is authorized (#8445 )

2026-02-25 12:31:04 -08:00

s3_multipart_iam.go

Allow multipart upload operations when s3:PutObject is authorized (#8445 )

2026-02-25 12:31:04 -08:00

s3_policy_templates_test.go

S3: Enforce bucket policy (#7471 )

2025-11-12 22:14:50 -08:00

s3_policy_templates.go

S3: Enforce bucket policy (#7471 )

2025-11-12 22:14:50 -08:00

s3_presigned_url_iam_test.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_presigned_url_iam.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_sse_bucket_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_c_range_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_c_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_c.go

fix: honor SSE-C chunk offsets in decryption for large chunked uploads (#8216 )

2026-02-04 22:57:41 -08:00

s3_sse_copy_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_ctr_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_error_test.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3_sse_http_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_kms_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_kms_utils.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3_sse_kms.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_metadata_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_metadata.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_multipart_test.go

fix: honor SSE-C chunk offsets in decryption for large chunked uploads (#8216 )

2026-02-04 22:57:41 -08:00

s3_sse_s3_integration_test.go

go fmt

2025-10-27 23:04:55 -07:00

s3_sse_s3_multipart_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_s3_test.go

fix: copy to bucket with default SSE-S3 encryption fails (#7562 ) (#7568 )

2025-11-28 13:28:17 -08:00

s3_sse_s3.go

filer: add structured error codes to CreateEntryResponse (#8767 )

2026-03-24 17:08:22 -07:00

s3_sse_test_utils_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_utils.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_token_differentiation_test.go

fix: comprehensive go vet error fixes and add CI enforcement (#7861 )

2025-12-23 14:48:50 -08:00

s3_validation_utils.go

go fmt

2025-10-27 23:04:55 -07:00

s3api_acl_helper_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_acl_helper.go

Add Kafka Gateway (#7231 )

2025-10-13 18:05:17 -07:00

s3api_acp.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_auth.go

Fix critical authentication bypass vulnerability (#7912 ) (#7915 )

2025-12-30 12:40:59 -08:00

s3api_bucket_config.go

fix: resolve CORS cache race condition causing stale 404 responses (#8748 )

2026-03-23 19:33:20 -07:00

s3api_bucket_cors_handlers.go

S3: add fallback for CORS (#7404 )

2025-10-29 13:43:27 -07:00

s3api_bucket_handlers_lifecycle_test.go

fix(s3): lifecycle TTL rules inherit replication and volumeGrowthCount from filer config (#8321 )

2026-02-12 16:46:05 -08:00

s3api_bucket_handlers_object_lock_config.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_bucket_handlers_test.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3api_bucket_handlers.go

fix(s3api): clear negative cache in autoCreateBucket when bucket exists

2026-03-11 13:49:15 -07:00

s3api_bucket_metadata_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_bucket_policy_arn_test.go

s3api: fix AccessDenied by correctly propagating principal ARN in vended tokens (#8330 )

2026-02-12 23:11:41 -08:00

s3api_bucket_policy_engine.go

Implement IAM propagation to S3 servers (#8130 )

2026-01-26 22:59:43 -08:00

s3api_bucket_policy_handlers.go

fix(s3): omit NotResource:null from bucket policy JSON response (#8658 )

2026-03-16 12:58:26 -07:00

s3api_bucket_tagging_handlers.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_circuit_breaker_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_circuit_breaker.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3api_conditional_headers_test.go

Refactor: Replace removeDuplicateSlashes with NormalizeObjectKey (#7873 )

2025-12-24 19:07:08 -08:00

s3api_copy_size_calculation.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3api_copy_validation.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_domain_test.go

fix: Use a mixed of virtual and path styles within a single subdomain (#7357 )

2025-10-24 01:45:22 -07:00

s3api_embedded_iam_test.go

fix(s3): omit NotResource:null from bucket policy JSON response (#8658 )

2026-03-16 12:58:26 -07:00

s3api_embedded_iam.go

fix(s3): omit NotResource:null from bucket policy JSON response (#8658 )

2026-03-16 12:58:26 -07:00

s3api_encrypted_volume_copy_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_etag_quoting_test.go

fix: multipart upload ETag calculation (#8238 )

2026-02-06 21:54:43 -08:00

s3api_governance_permissions_test.go

s3: enforce authentication and JSON error format for Iceberg REST Catalog (#8192 )

2026-02-03 11:55:12 -08:00

s3api_handlers.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_implicit_directory_test.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_key_rotation.go

s3: enforce authentication and JSON error format for Iceberg REST Catalog (#8192 )

2026-02-03 11:55:12 -08:00

s3api_list_normalization_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_nextmarker_test.go

fix: S3 listing NextMarker missing intermediate directory component (#8089 )

2026-01-22 16:56:35 -08:00

s3api_object_handlers_acl.go

Add Iceberg admin UI (#8246 )

2026-02-08 20:06:32 -08:00

s3api_object_handlers_attributes.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3api_object_handlers_copy_test.go

fix: copy to bucket with default SSE-S3 encryption fails (#7562 ) (#7568 )

2025-11-28 13:28:17 -08:00

s3api_object_handlers_copy_unified.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_object_handlers_copy.go

S3: fix silent PutObject failure and enforce 1024-byte key limit (#8764 )

2026-03-24 13:35:28 -07:00

s3api_object_handlers_delete.go

Fix S3 delete for non-empty directory markers (#8740 )

2026-03-23 13:35:16 -07:00

s3api_object_handlers_legal_hold.go

adjust logs

2026-01-17 18:40:48 -08:00

s3api_object_handlers_list_directory_test.go

fix: directory incorrectly listed as object in S3 ListObjects (#7939 )

2026-01-02 15:52:37 -08:00

s3api_object_handlers_list_test.go

fix(s3api): ListObjects with trailing-slash prefix matches sibling directories (#8599 )

2026-03-11 02:28:34 -07:00

s3api_object_handlers_list_versioned_test.go

fix: ListObjectVersions interleave Version and DeleteMarker in sort order (#8567 )

2026-03-09 12:37:59 -07:00

s3api_object_handlers_list.go

fix(s3): include directory markers in ListObjects without delimiter (#8704 )

2026-03-19 15:36:11 -07:00

s3api_object_handlers_multipart.go

S3: reject part uploads after AbortMultipartUpload (#8768 )

2026-03-24 18:11:51 -07:00

s3api_object_handlers_postpolicy_test.go

Refactor: Replace removeDuplicateSlashes with NormalizeObjectKey (#7873 )

2025-12-24 19:07:08 -08:00

s3api_object_handlers_postpolicy.go

Add Iceberg admin UI (#8246 )

2026-02-08 20:06:32 -08:00

s3api_object_handlers_put_test.go

filer: add structured error codes to CreateEntryResponse (#8767 )

2026-03-24 17:08:22 -07:00

s3api_object_handlers_put.go

fix S3 conditional header TOCTOU race during concurrent writes (#8800 )

2026-03-27 12:42:57 -07:00

s3api_object_handlers_retention.go

refactor (#6999 )

2025-07-19 00:49:56 -07:00

s3api_object_handlers_tagging.go

Add Iceberg admin UI (#8246 )

2026-02-08 20:06:32 -08:00

s3api_object_handlers_test.go

fix: multipart upload ETag calculation (#8238 )

2026-02-06 21:54:43 -08:00

s3api_object_handlers.go

fix: cancel volume server requests on client disconnect during S3 downloads (#8373 )

2026-02-18 17:14:54 -08:00

s3api_object_lock_fix_test.go

Fix get object lock configuration handler (#6996 )

2025-07-18 02:19:50 -07:00

s3api_object_lock_headers_test.go

Test object lock and retention (#6997 )

2025-07-18 22:25:58 -07:00

s3api_object_ownership_test.go

s3: implement Bucket Owner Enforced for object ownership (#7913 )

2025-12-29 23:54:00 -08:00

s3api_object_retention_test.go

S3: S3 Object Retention API to include XML namespace support (#7517 )

2025-11-20 11:42:22 -08:00

s3api_object_retention.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_object_versioning.go

Fix S3 delete for non-empty directory markers (#8740 )

2026-03-23 13:35:16 -07:00

s3api_policy.go

[s3] Put bucket lifecycle configuration (#5510 )

2024-04-27 07:39:22 -07:00

s3api_put_handlers.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_put_object_helper_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3api_put_object_helper.go

s3api: remove redundant auth verification in getRequestDataReader (#7685 )

2025-12-09 10:24:35 -08:00

s3api_remote_storage_test.go

fix: S3 remote storage cold-cache read fails with 'size reported but no content available' (#7817 )

2025-12-18 21:19:44 -08:00

s3api_server_grpc.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

s3api_server_routing_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3api_server.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

s3api_sosapi_test.go

s3: Add SOSAPI support for Veeam integration (#7899 )

2025-12-28 14:07:58 -08:00

s3api_sosapi.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_sse_chunk_metadata_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_sse_decrypt_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_sse_s3_upload_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_status_handlers.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_streaming_copy.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_sts_assume_role_test.go

Embed role policies in AssumeRole STS tokens (#8421 )

2026-02-23 22:59:53 -08:00

s3api_sts.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

s3api_tables_rest_validation_test.go

s3api: return 400 for invalid namespace query in REST table routes (#8296 )

2026-02-10 17:57:08 -08:00

s3api_tables.go

Enforce IAM for S3 Tables bucket creation (#8388 )

2026-02-19 22:52:05 -08:00

s3api_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_version_id_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_version_id.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_xsd_generated_helper.go

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3api_xsd_generated.go

fix ListAllMyBucketsResult xmlns

2025-08-14 20:38:03 -07:00

stats.go

Populate bucket_traffic_received_bytes_total metric (#7249 )

2025-09-17 19:04:51 -07:00

sts_params_test.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

tags_test.go

tag parsing decode url encoded

2025-07-28 02:49:43 -07:00

tags.go

Add s3tables shell and admin UI (#8172 )

2026-01-30 22:57:05 -08:00

README.txt

see https://blog.aqwari.net/xml-schema-go/

1. go get aqwari.net/xml/cmd/xsdgen
2. Add EncodingType element for ListBucketResult in AmazonS3.xsd
3. xsdgen -o s3api_xsd_generated.go -pkg s3api AmazonS3.xsd
4. Remove empty Grantee struct in s3api_xsd_generated.go
5. Remove xmlns: sed s'/http:\/\/s3.amazonaws.com\/doc\/2006-03-01\/\ //' s3api_xsd_generated.go